Jul 06 17:40:30.821369 ip-10-0-133-100 systemd[1]: Starting Kubernetes Kubelet... Jul 06 17:40:31.229127 ip-10-0-133-100 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:40:31.229127 ip-10-0-133-100 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 17:40:31.229127 ip-10-0-133-100 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:40:31.229127 ip-10-0-133-100 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 17:40:31.229127 ip-10-0-133-100 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:40:31.229127 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.228764 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234031 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234046 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234052 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234057 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234062 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234067 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234071 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234075 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234079 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234083 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234087 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234091 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234096 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234102 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234106 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234110 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234126 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234131 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:40:31.235008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234135 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234149 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234153 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234157 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234161 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234164 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234169 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234173 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234176 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234180 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234185 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234188 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234192 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234196 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234200 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234204 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234207 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234211 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234214 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234218 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:40:31.235664 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234222 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234226 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234229 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234233 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234237 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234241 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234246 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234249 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234255 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234261 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234264 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234269 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234272 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234275 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234280 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234284 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234287 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234291 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234295 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:40:31.236726 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234298 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234304 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234309 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234313 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234318 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234322 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234326 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234330 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234334 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234338 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234342 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234346 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234350 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234354 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234358 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234362 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234365 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234369 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234372 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234376 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:40:31.237405 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234380 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234384 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234388 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234392 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234396 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234402 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234406 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234411 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234415 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234420 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234424 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234428 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234432 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234437 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234441 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234445 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234448 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234452 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234456 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:40:31.238711 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234459 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234463 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.234467 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235479 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235488 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235492 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235496 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235500 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235504 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235508 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235511 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235516 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235520 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235523 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235528 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235532 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235536 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235541 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235544 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235548 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:40:31.239547 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235551 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235555 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235559 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235563 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235566 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235570 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235573 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235580 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235585 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235589 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235593 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235597 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235600 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235604 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235608 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235612 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235615 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235619 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235623 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:40:31.240598 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235628 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235632 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235636 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235640 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235644 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235648 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235653 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235657 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235661 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235666 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235672 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235677 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235681 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235685 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235689 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235692 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235696 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235700 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235704 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235707 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:40:31.241847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235711 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235714 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235718 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235722 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235725 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235729 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235734 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235737 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235741 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235747 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235751 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235755 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235760 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235766 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235770 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235774 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235779 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235783 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235788 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:40:31.242400 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235792 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235795 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235799 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235803 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235807 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235811 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235814 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235818 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235822 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235826 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235830 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235833 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235837 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235840 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235844 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235848 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235851 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235855 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235858 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235862 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:40:31.242872 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235866 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235870 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235873 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.235877 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236491 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236501 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236506 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236512 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236517 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236522 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236526 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236530 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236534 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236538 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236542 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236546 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236550 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236553 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236557 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:40:31.243399 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236561 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236564 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236569 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236572 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236576 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236580 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236584 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236587 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236591 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236595 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236598 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236601 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236605 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236610 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236614 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236618 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236622 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236626 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236630 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:40:31.243859 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236634 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236637 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236641 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236645 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236649 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236653 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236657 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236660 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236664 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236669 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236673 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236677 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236680 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236684 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236687 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236691 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236694 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236698 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236701 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236705 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:40:31.244347 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236709 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236712 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236716 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236720 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236723 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236727 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236731 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236735 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236739 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236743 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236747 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236751 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236755 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236761 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236764 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236768 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236772 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236776 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236779 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236785 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:40:31.244846 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236790 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236794 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236799 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236804 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236808 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236813 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236817 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236821 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236824 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236828 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236832 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236836 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236839 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236843 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236847 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236850 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236854 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236857 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236861 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236864 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:40:31.245335 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236868 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236872 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236875 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236881 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.236885 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.236971 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.236980 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.236988 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.236995 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237001 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237005 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237012 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237018 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237022 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237027 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237032 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237037 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237042 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237047 2577 flags.go:64] FLAG: --cgroup-root="" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237051 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237055 2577 flags.go:64] FLAG: --client-ca-file="" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237059 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237063 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237071 2577 flags.go:64] FLAG: --cluster-domain="" Jul 06 17:40:31.245908 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237075 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237081 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237086 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237091 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237096 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237101 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237105 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237110 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237128 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237133 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237138 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237144 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237148 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237154 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237159 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237163 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237168 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237172 2577 flags.go:64] FLAG: --enable-server="true" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237176 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237183 2577 flags.go:64] FLAG: --event-burst="100" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237187 2577 flags.go:64] FLAG: --event-qps="50" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237191 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237195 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237199 2577 flags.go:64] FLAG: --eviction-hard="" Jul 06 17:40:31.246528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237209 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237213 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237218 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237223 2577 flags.go:64] FLAG: --eviction-soft="" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237228 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237232 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237236 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237241 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237245 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237251 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237255 2577 flags.go:64] FLAG: --feature-gates="" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237260 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237265 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237269 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237273 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237277 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237281 2577 flags.go:64] FLAG: --help="false" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237286 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-133-100.ec2.internal" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237290 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237295 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237300 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237305 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237310 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237314 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 17:40:31.247284 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237318 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237322 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237327 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237331 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237336 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237340 2577 flags.go:64] FLAG: --kube-reserved="" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237345 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237349 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237353 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237358 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237363 2577 flags.go:64] FLAG: --lock-file="" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237366 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237371 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237375 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237383 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237387 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237391 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237396 2577 flags.go:64] FLAG: --logging-format="text" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237400 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237405 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237409 2577 flags.go:64] FLAG: --manifest-url="" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237413 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237419 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237424 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237431 2577 flags.go:64] FLAG: --max-pods="110" Jul 06 17:40:31.248346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237435 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237439 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237445 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237449 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237453 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237458 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237462 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237472 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237477 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237481 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237485 2577 flags.go:64] FLAG: --pod-cidr="" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237489 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237497 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237501 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237505 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237510 2577 flags.go:64] FLAG: --port="10250" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237514 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237519 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c1b01be5adeb3125" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237524 2577 flags.go:64] FLAG: --qos-reserved="" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237528 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237533 2577 flags.go:64] FLAG: --register-node="true" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237537 2577 flags.go:64] FLAG: --register-with-taints="" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237542 2577 flags.go:64] FLAG: --registry-burst="10" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237546 2577 flags.go:64] FLAG: --registry-qps="5" Jul 06 17:40:31.249385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237551 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237556 2577 flags.go:64] FLAG: --reserved-memory="" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237562 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237566 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237571 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237574 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237579 2577 flags.go:64] FLAG: --runonce="false" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237583 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237588 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237593 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237597 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237602 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237606 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237611 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237615 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237619 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237623 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237627 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237631 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237636 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237639 2577 flags.go:64] FLAG: --system-cgroups="" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237643 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237651 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237656 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237660 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 17:40:31.250427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237665 2577 flags.go:64] FLAG: --tls-min-version="" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237671 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237675 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237679 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237683 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237687 2577 flags.go:64] FLAG: --v="2" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237693 2577 flags.go:64] FLAG: --version="false" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237699 2577 flags.go:64] FLAG: --vmodule="" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237705 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.237710 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.238958 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.238980 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.238988 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.238993 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239000 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239005 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239012 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239016 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239023 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239028 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239035 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:40:31.251293 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239045 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239049 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239055 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239060 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239064 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239070 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239074 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239080 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239084 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239091 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239096 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239101 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239111 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239135 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239142 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239146 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239152 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239157 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239163 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239182 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:40:31.252005 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239205 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239211 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239215 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239221 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239226 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239231 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239235 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239240 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239244 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239249 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239257 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239270 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239275 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239279 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239284 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239288 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239293 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239298 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239303 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:40:31.252556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239307 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239311 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239314 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239317 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239319 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239325 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239328 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239331 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239333 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239336 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239339 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239341 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239345 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239350 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239353 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239356 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239359 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239365 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239368 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239371 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:40:31.253035 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239374 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239376 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239379 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239382 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239385 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239388 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239392 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239396 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239399 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239402 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239407 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239410 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239413 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239416 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239418 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239421 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239424 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239427 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239430 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:40:31.253904 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239432 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239435 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239438 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239443 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239446 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239452 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239455 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239460 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239464 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.239466 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.240188 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.249231 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.249255 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.249296 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.249305 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 17:40:31.254481 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249392 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249401 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249405 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249410 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249414 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249419 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249424 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249429 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249433 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249438 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249443 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249448 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249453 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249458 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249462 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249467 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249473 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249477 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249482 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249487 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:40:31.255008 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249491 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249495 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249501 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249508 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249514 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249518 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249522 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249526 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249531 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249536 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249540 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249544 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249550 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249554 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249558 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249563 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249567 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249571 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249576 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249580 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:40:31.255556 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249584 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249588 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249592 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249596 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249601 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249605 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249609 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249613 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249617 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249622 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249626 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249630 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249634 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249638 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249643 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249647 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249652 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249656 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249660 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249664 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:40:31.256044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249668 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249673 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249678 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249683 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249687 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249691 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249696 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249700 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249704 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249708 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249712 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249716 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249720 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249725 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249729 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249733 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249737 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249741 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249745 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249750 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:40:31.256589 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249753 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249758 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249764 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249770 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249775 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249780 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249784 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249789 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249794 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249798 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249803 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249807 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249812 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249817 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249824 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249830 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249834 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249839 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:40:31.257146 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.249843 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.249852 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250040 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250047 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250052 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250058 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250062 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250066 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250071 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250075 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250079 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250083 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250088 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250093 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250096 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:40:31.257594 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250100 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250105 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250109 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250129 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250134 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250138 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250142 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250146 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250151 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250155 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250159 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250163 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250168 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250172 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250177 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250181 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250186 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250190 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250194 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:40:31.258020 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250198 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250202 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250206 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250211 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250217 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250223 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250227 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250232 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250236 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250243 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250248 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250254 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250259 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250263 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250267 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250271 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250276 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250280 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250285 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:40:31.258685 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250289 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250293 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250297 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250301 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250305 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250309 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250313 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250317 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250322 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250326 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250331 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250336 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250340 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250344 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250348 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250352 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250356 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250360 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250364 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250368 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:40:31.259464 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250373 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250379 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250385 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250389 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250394 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250404 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250409 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250413 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250417 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250422 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250426 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250430 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250434 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250439 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250443 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250447 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250451 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250455 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250459 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250464 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:40:31.260309 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250468 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250472 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250477 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250481 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250485 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250489 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250494 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:31.250498 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.250506 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.250700 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.254686 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.256152 2577 server.go:1019] "Starting client certificate rotation" Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.256272 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 17:40:31.261044 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.256323 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 17:40:31.261387 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.258960 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 17:40:31.261387 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.260830 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 17:40:31.271305 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.271288 2577 log.go:25] "Validated CRI v1 runtime API" Jul 06 17:40:31.278068 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.278051 2577 log.go:25] "Validated CRI v1 image API" Jul 06 17:40:31.278901 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.278885 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 17:40:31.282001 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.281952 2577 fs.go:135] Filesystem UUIDs: map[5c75c844-6711-4e51-a9a5-077a19ac66e5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9854402f-b3ba-4a9d-923a-876d3788ab72:/dev/nvme0n1p3] Jul 06 17:40:31.282196 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.282134 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 17:40:31.288644 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.288528 2577 manager.go:216] Machine: {Timestamp:2026-07-06 17:40:31.287365507 +0000 UTC m=+0.343682463 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098949 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29c3a0f733ba613fca9dc59d176d3a SystemUUID:ec29c3a0-f733-ba61-3fca-9dc59d176d3a BootID:51b2f1d2-88da-431a-99fe-0a577ba108cd Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e1:0e:c5:e1:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e1:0e:c5:e1:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:30:9f:f1:bf:07 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 17:40:31.288644 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.288631 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 17:40:31.288773 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.288749 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 17:40:31.291819 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.291788 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 17:40:31.291978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.291823 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 17:40:31.292604 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.292593 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 17:40:31.292656 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.292609 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 17:40:31.292656 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.292620 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 17:40:31.293419 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.293407 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 17:40:31.294748 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.294737 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 17:40:31.296273 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.296254 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 17:40:31.297945 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.297932 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 06 17:40:31.298081 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.298070 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 17:40:31.298155 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.298107 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 06 17:40:31.298155 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.298136 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 17:40:31.298252 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.298160 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 17:40:31.298252 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.298174 2577 kubelet.go:398] "Adding apiserver pod source" Jul 06 17:40:31.298252 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.298187 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 17:40:31.298549 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.298535 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 17:40:31.298607 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.298558 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 17:40:31.300695 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.300671 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 17:40:31.302477 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.302465 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 17:40:31.302529 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.302495 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 17:40:31.304138 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304110 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 17:40:31.304201 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304145 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 17:40:31.304201 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304154 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 17:40:31.304201 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304162 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 17:40:31.304201 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304174 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 17:40:31.304201 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304182 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 17:40:31.304201 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304192 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 17:40:31.304201 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304200 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 17:40:31.304383 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304209 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 17:40:31.304383 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304217 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 17:40:31.304383 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304228 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 17:40:31.304383 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.304236 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 17:40:31.305261 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.305247 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 17:40:31.305469 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.305461 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 17:40:31.306852 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.306828 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 17:40:31.306980 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.306961 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 17:40:31.307157 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.307143 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 17:40:31.309193 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.309181 2577 server.go:1268] "Started kubelet" Jul 06 17:40:31.309911 ip-10-0-133-100 systemd[1]: Started Kubernetes Kubelet. Jul 06 17:40:31.312548 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.312497 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 17:40:31.312625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.312560 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 17:40:31.314371 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.314353 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 17:40:31.314446 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.314417 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 17:40:31.315462 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.315441 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wj8jd" Jul 06 17:40:31.316292 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.316268 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 17:40:31.316725 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.315453 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-100.ec2.internal.18bfc422d2f413b9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-100.ec2.internal,UID:ip-10-0-133-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-100.ec2.internal,},FirstTimestamp:2026-07-06 17:40:31.309149113 +0000 UTC m=+0.365466067,LastTimestamp:2026-07-06 17:40:31.309149113 +0000 UTC m=+0.365466067,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-100.ec2.internal,}" Jul 06 17:40:31.317463 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.317451 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 06 17:40:31.319709 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.319689 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wj8jd" Jul 06 17:40:31.320292 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.320280 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 17:40:31.320437 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.320417 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 17:40:31.320617 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.320600 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:31.321072 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321055 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 17:40:31.321255 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321215 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 17:40:31.321255 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321223 2577 factory.go:55] Registering systemd factory Jul 06 17:40:31.321255 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321230 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 17:40:31.321255 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321238 2577 factory.go:223] Registration of the systemd container factory successfully Jul 06 17:40:31.321467 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321332 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 06 17:40:31.321467 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321339 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 06 17:40:31.321467 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321406 2577 factory.go:153] Registering CRI-O factory Jul 06 17:40:31.321467 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321417 2577 factory.go:223] Registration of the crio container factory successfully Jul 06 17:40:31.321467 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321460 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 17:40:31.321674 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321480 2577 factory.go:103] Registering Raw factory Jul 06 17:40:31.321674 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.321495 2577 manager.go:1196] Started watching for new ooms in manager Jul 06 17:40:31.322530 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.322509 2577 manager.go:349] Starting recovery of all containers Jul 06 17:40:31.332401 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.332372 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 17:40:31.332486 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.332415 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 17:40:31.332995 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.332982 2577 manager.go:354] Recovery completed Jul 06 17:40:31.336876 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.336862 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:40:31.338501 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.338486 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:40:31.338559 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.338519 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:40:31.338559 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.338530 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:40:31.339001 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.338985 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 17:40:31.339001 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.339000 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 17:40:31.339131 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.339002 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:40:31.339131 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.339013 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 06 17:40:31.339580 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.339564 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:40:31.339637 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.339594 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:40:31.339637 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.339610 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:40:31.340205 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.340194 2577 policy_none.go:49] "None policy: Start" Jul 06 17:40:31.340258 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.340208 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 17:40:31.340258 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.340218 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 17:40:31.341250 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.341239 2577 policy_none.go:47] "Start" Jul 06 17:40:31.375785 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.375650 2577 manager.go:337] "Starting Device Plugin manager" Jul 06 17:40:31.375785 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.375773 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 17:40:31.375785 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.375786 2577 server.go:87] "Starting device plugin registration server" Jul 06 17:40:31.376010 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.375998 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 17:40:31.376062 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.376012 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 17:40:31.376131 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.376104 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 17:40:31.376205 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.376189 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 17:40:31.376205 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.376203 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 17:40:31.376643 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.376625 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 17:40:31.376718 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.376672 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:31.457783 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.457749 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 17:40:31.458941 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.458924 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 17:40:31.458994 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.458970 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 17:40:31.459028 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.458998 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 17:40:31.459062 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.459039 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 17:40:31.460689 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.460672 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:40:31.476750 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.476736 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:40:31.477973 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.477954 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:40:31.478055 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.477988 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:40:31.478055 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.478000 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:40:31.478055 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.478021 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-100.ec2.internal" Jul 06 17:40:31.484854 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:31.484840 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-100.ec2.internal" Jul 06 17:40:31.484908 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.484860 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-100.ec2.internal\": node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:31.501839 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:31.501814 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:32.906211 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.906175 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal"] Jul 06 17:40:32.906308 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.906253 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:40:32.907047 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.907032 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:40:32.907126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.907059 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:40:32.907126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.907069 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:40:32.908216 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.908203 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:40:32.908346 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.908330 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" Jul 06 17:40:32.908406 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.908367 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:40:32.908874 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.908860 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:40:32.908938 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.908866 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:40:32.908938 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.908917 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:40:32.908938 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.908928 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:40:32.909027 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.908898 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:40:32.909027 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.908965 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:40:32.910250 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.910235 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal" Jul 06 17:40:32.910301 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.910259 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:40:32.910917 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.910879 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:40:32.910917 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.910902 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:40:32.910917 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.910917 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:40:32.934062 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:32.934039 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-100.ec2.internal\" not found" node="ip-10-0-133-100.ec2.internal" Jul 06 17:40:32.938299 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:32.938285 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-100.ec2.internal\" not found" node="ip-10-0-133-100.ec2.internal" Jul 06 17:40:32.948618 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:32.948602 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:32.969358 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.969336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eddb2e3f65553b7b2293a5bad4aec16a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal\" (UID: \"eddb2e3f65553b7b2293a5bad4aec16a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" Jul 06 17:40:32.969436 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.969360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddb2e3f65553b7b2293a5bad4aec16a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal\" (UID: \"eddb2e3f65553b7b2293a5bad4aec16a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" Jul 06 17:40:32.969436 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:32.969376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9530b52cc90d833d2a92ae3eb83d4cd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-100.ec2.internal\" (UID: \"d9530b52cc90d833d2a92ae3eb83d4cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.049463 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.049401 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:33.069707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.069684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddb2e3f65553b7b2293a5bad4aec16a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal\" (UID: \"eddb2e3f65553b7b2293a5bad4aec16a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.069764 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.069712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9530b52cc90d833d2a92ae3eb83d4cd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-100.ec2.internal\" (UID: \"d9530b52cc90d833d2a92ae3eb83d4cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.069764 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.069730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eddb2e3f65553b7b2293a5bad4aec16a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal\" (UID: \"eddb2e3f65553b7b2293a5bad4aec16a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.069825 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.069770 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eddb2e3f65553b7b2293a5bad4aec16a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal\" (UID: \"eddb2e3f65553b7b2293a5bad4aec16a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.069825 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.069790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddb2e3f65553b7b2293a5bad4aec16a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal\" (UID: \"eddb2e3f65553b7b2293a5bad4aec16a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.069825 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.069790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9530b52cc90d833d2a92ae3eb83d4cd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-100.ec2.internal\" (UID: \"d9530b52cc90d833d2a92ae3eb83d4cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.150150 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.150112 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:33.237635 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.237604 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.242626 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.242606 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.250333 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.250313 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:33.350865 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.350800 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:33.451822 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.451794 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-100.ec2.internal\" not found" Jul 06 17:40:33.456767 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.456753 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:40:33.468069 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.468048 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.478045 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.478027 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 17:40:33.479928 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.479916 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal" Jul 06 17:40:33.487315 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.487299 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 17:40:33.602240 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.602150 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 17:40:33.602732 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.602324 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 17:40:33.602732 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.602336 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 17:40:33.645446 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.645423 2577 apiserver.go:52] "Watching apiserver" Jul 06 17:40:33.664001 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.663976 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 17:40:33.664351 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.664329 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal","openshift-cluster-node-tuning-operator/tuned-c458d","openshift-dns/node-resolver-rkqhf","openshift-multus/network-metrics-daemon-7jgm5","openshift-ovn-kubernetes/ovnkube-node-d2q89","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq","openshift-image-registry/node-ca-6kpx2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal","openshift-multus/multus-additional-cni-plugins-v8tkt","openshift-multus/multus-dgxth","openshift-network-diagnostics/network-check-target-wxvxk","openshift-network-operator/iptables-alerter-hwwvq","kube-system/global-pull-secret-syncer-z7cwn","kube-system/konnectivity-agent-bgkx2"] Jul 06 17:40:33.666037 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.666023 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.667016 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.666994 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 17:40:33.667387 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.667369 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:33.667456 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.667431 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:33.668699 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.668681 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 17:40:33.668859 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.668683 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rvh4q\"" Jul 06 17:40:33.668920 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.668905 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 17:40:33.668957 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.668920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.668957 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.668943 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 17:40:33.670154 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.670138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:33.670265 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.670202 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:33.671295 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.671270 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sht4m\"" Jul 06 17:40:33.671640 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.671410 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 17:40:33.672280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.671685 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 17:40:33.672280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.671771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.673128 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-dbus\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:33.673453 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673422 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85ae0f7-be74-4213-a011-2ca424f86604-tmp-dir\") pod \"node-resolver-rkqhf\" (UID: \"e85ae0f7-be74-4213-a011-2ca424f86604\") " pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.673590 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc9ls\" (UniqueName: \"kubernetes.io/projected/519470ee-d1c3-4103-9d2f-a0930c92c9d8-kube-api-access-lc9ls\") pod \"node-ca-6kpx2\" (UID: \"519470ee-d1c3-4103-9d2f-a0930c92c9d8\") " pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.673590 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-kubelet-config\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:33.673590 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:33.673590 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e85ae0f7-be74-4213-a011-2ca424f86604-hosts-file\") pod \"node-resolver-rkqhf\" (UID: \"e85ae0f7-be74-4213-a011-2ca424f86604\") " pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.673590 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ngs\" (UniqueName: \"kubernetes.io/projected/e85ae0f7-be74-4213-a011-2ca424f86604-kube-api-access-h7ngs\") pod \"node-resolver-rkqhf\" (UID: \"e85ae0f7-be74-4213-a011-2ca424f86604\") " pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.673846 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/519470ee-d1c3-4103-9d2f-a0930c92c9d8-host\") pod \"node-ca-6kpx2\" (UID: \"519470ee-d1c3-4103-9d2f-a0930c92c9d8\") " pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.673846 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/519470ee-d1c3-4103-9d2f-a0930c92c9d8-serviceca\") pod \"node-ca-6kpx2\" (UID: \"519470ee-d1c3-4103-9d2f-a0930c92c9d8\") " pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.673846 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.673780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.674228 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.674209 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 17:40:33.674626 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.674604 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 17:40:33.674727 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.674691 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k4blr\"" Jul 06 17:40:33.675261 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.675248 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.676337 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.676300 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 17:40:33.676337 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.676322 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 17:40:33.676486 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.676354 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 17:40:33.676486 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.676339 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 17:40:33.676486 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.676394 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 17:40:33.676486 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.676456 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 17:40:33.676693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.676615 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 17:40:33.676693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.676684 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:33.676789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.676700 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g6k2d\"" Jul 06 17:40:33.677659 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.677640 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 17:40:33.677804 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.677769 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 17:40:33.677872 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.677818 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 17:40:33.678098 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.678079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 17:40:33.678188 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.678119 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zf5v8\"" Jul 06 17:40:33.678188 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.678134 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 17:40:33.678340 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.678325 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.679498 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.679444 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 17:40:33.679582 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.679496 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 17:40:33.679582 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.679510 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kqd5g\"" Jul 06 17:40:33.680460 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.680414 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 17:35:32 +0000 UTC" deadline="2028-03-24 13:20:41.803199154 +0000 UTC" Jul 06 17:40:33.680460 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.680458 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15043h40m8.122744025s" Jul 06 17:40:33.680632 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.680521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.680933 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.680907 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:40:33.680933 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.680911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 17:40:33.681064 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.680974 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hbxhk\"" Jul 06 17:40:33.681756 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.681742 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 17:40:33.682071 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.682056 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:33.682145 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.682105 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:33.683025 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.683010 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-49dxz\"" Jul 06 17:40:33.683280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.683266 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 17:40:33.684212 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.684183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.686977 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.686953 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 17:40:33.687282 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.687263 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:40:33.687381 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.687315 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 17:40:33.687562 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.687529 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8qb8p\"" Jul 06 17:40:33.703939 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.703921 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pfdf4" Jul 06 17:40:33.709453 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.709436 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pfdf4" Jul 06 17:40:33.769137 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.769118 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 17:40:33.774567 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:33.774677 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d37167cf-1773-4b70-a0cd-7b1f84c45439-konnectivity-ca\") pod \"konnectivity-agent-bgkx2\" (UID: \"d37167cf-1773-4b70-a0cd-7b1f84c45439\") " pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:33.774677 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-run-multus-certs\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.774677 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-run-systemd\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.774677 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b7165f3-594c-47cd-b186-b47db2cafefe-ovnkube-script-lib\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.774677 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-device-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.774851 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.774701 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:33.774851 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc9ls\" (UniqueName: \"kubernetes.io/projected/519470ee-d1c3-4103-9d2f-a0930c92c9d8-kube-api-access-lc9ls\") pod \"node-ca-6kpx2\" (UID: \"519470ee-d1c3-4103-9d2f-a0930c92c9d8\") " pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.774851 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.774794 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret podName:3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc nodeName:}" failed. No retries permitted until 2026-07-06 17:40:34.274773585 +0000 UTC m=+1.984658120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret") pod "global-pull-secret-syncer-z7cwn" (UID: "3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:33.774851 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.775053 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774919 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-cni-dir\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.775053 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-cni-bin\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.775053 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.774980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b7165f3-594c-47cd-b186-b47db2cafefe-env-overrides\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.775053 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ngs\" (UniqueName: \"kubernetes.io/projected/e85ae0f7-be74-4213-a011-2ca424f86604-kube-api-access-h7ngs\") pod \"node-resolver-rkqhf\" (UID: \"e85ae0f7-be74-4213-a011-2ca424f86604\") " pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.775053 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-hostroot\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.775229 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-kubelet\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.775229 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-etc-openvswitch\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.775229 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-run-openvswitch\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.775229 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-modprobe-d\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.775229 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775175 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-kubernetes\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.775229 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xkb8\" (UniqueName: \"kubernetes.io/projected/7b7165f3-594c-47cd-b186-b47db2cafefe-kube-api-access-8xkb8\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-socket-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-var-lib-cni-multus\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chm8d\" (UniqueName: \"kubernetes.io/projected/c70be7ac-b3e8-486e-8013-06c82f36ba37-kube-api-access-chm8d\") pod \"iptables-alerter-hwwvq\" (UID: \"c70be7ac-b3e8-486e-8013-06c82f36ba37\") " pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhswr\" (UniqueName: \"kubernetes.io/projected/6f08132d-2a61-4afc-b235-98fe6694c5cb-kube-api-access-jhswr\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-run-netns\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-dbus\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-cni-binary-copy\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-cni-binary-copy\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775394 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b7165f3-594c-47cd-b186-b47db2cafefe-ovnkube-config\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-kubelet-config\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e85ae0f7-be74-4213-a011-2ca424f86604-hosts-file\") pod \"node-resolver-rkqhf\" (UID: \"e85ae0f7-be74-4213-a011-2ca424f86604\") " pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-kubelet-config\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:33.775468 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775466 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-sys\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-var-lib-kubelet\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-tuned\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e85ae0f7-be74-4213-a011-2ca424f86604-hosts-file\") pod \"node-resolver-rkqhf\" (UID: \"e85ae0f7-be74-4213-a011-2ca424f86604\") " pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775505 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-dbus\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775515 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-system-cni-dir\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-os-release\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-lib-modules\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-socket-dir-parent\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-etc-kubernetes\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/519470ee-d1c3-4103-9d2f-a0930c92c9d8-serviceca\") pod \"node-ca-6kpx2\" (UID: \"519470ee-d1c3-4103-9d2f-a0930c92c9d8\") " pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-systemd\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-run-netns\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf8vg\" (UniqueName: \"kubernetes.io/projected/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-kube-api-access-lf8vg\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-sysctl-conf\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-var-lib-cni-bin\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.776142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-var-lib-openvswitch\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-node-log\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b7165f3-594c-47cd-b186-b47db2cafefe-ovn-node-metrics-cert\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85ae0f7-be74-4213-a011-2ca424f86604-tmp-dir\") pod \"node-resolver-rkqhf\" (UID: \"e85ae0f7-be74-4213-a011-2ca424f86604\") " pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d37167cf-1773-4b70-a0cd-7b1f84c45439-agent-certs\") pod \"konnectivity-agent-bgkx2\" (UID: \"d37167cf-1773-4b70-a0cd-7b1f84c45439\") " pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775942 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-sysctl-d\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-host\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c70be7ac-b3e8-486e-8013-06c82f36ba37-host-slash\") pod \"iptables-alerter-hwwvq\" (UID: \"c70be7ac-b3e8-486e-8013-06c82f36ba37\") " pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-systemd-units\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.775997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-sys-fs\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/519470ee-d1c3-4103-9d2f-a0930c92c9d8-serviceca\") pod \"node-ca-6kpx2\" (UID: \"519470ee-d1c3-4103-9d2f-a0930c92c9d8\") " pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/519470ee-d1c3-4103-9d2f-a0930c92c9d8-host\") pod \"node-ca-6kpx2\" (UID: \"519470ee-d1c3-4103-9d2f-a0930c92c9d8\") " pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-run-k8s-cni-cncf-io\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-slash\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776066 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/519470ee-d1c3-4103-9d2f-a0930c92c9d8-host\") pod \"node-ca-6kpx2\" (UID: \"519470ee-d1c3-4103-9d2f-a0930c92c9d8\") " pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776070 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85ae0f7-be74-4213-a011-2ca424f86604-tmp-dir\") pod \"node-resolver-rkqhf\" (UID: \"e85ae0f7-be74-4213-a011-2ca424f86604\") " pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-registration-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.776978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pms2\" (UniqueName: \"kubernetes.io/projected/620c49b1-4dd3-413a-8fdc-5531058b83b0-kube-api-access-5pms2\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/850ea1b7-2642-4951-9c4e-dedc749fa546-tmp\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxrgd\" (UniqueName: \"kubernetes.io/projected/850ea1b7-2642-4951-9c4e-dedc749fa546-kube-api-access-cxrgd\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-os-release\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdkpv\" (UniqueName: \"kubernetes.io/projected/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-kube-api-access-gdkpv\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-var-lib-kubelet\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-conf-dir\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-run-ovn-kubernetes\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-sysconfig\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-run\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-cnibin\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-daemon-config\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-run-ovn\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.777832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-log-socket\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.778610 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-cnibin\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.778610 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-system-cni-dir\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.778610 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c70be7ac-b3e8-486e-8013-06c82f36ba37-iptables-alerter-script\") pod \"iptables-alerter-hwwvq\" (UID: \"c70be7ac-b3e8-486e-8013-06c82f36ba37\") " pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.778610 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-cni-netd\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.778610 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.778610 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.776514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.784587 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.784568 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 17:40:33.787465 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.787447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc9ls\" (UniqueName: \"kubernetes.io/projected/519470ee-d1c3-4103-9d2f-a0930c92c9d8-kube-api-access-lc9ls\") pod \"node-ca-6kpx2\" (UID: \"519470ee-d1c3-4103-9d2f-a0930c92c9d8\") " pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:33.787465 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.787458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ngs\" (UniqueName: \"kubernetes.io/projected/e85ae0f7-be74-4213-a011-2ca424f86604-kube-api-access-h7ngs\") pod \"node-resolver-rkqhf\" (UID: \"e85ae0f7-be74-4213-a011-2ca424f86604\") " pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:33.792896 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:33.792875 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddb2e3f65553b7b2293a5bad4aec16a.slice/crio-7aa538e917dffa1ae833a4c6babe36cee8befcea9012b59807c38fa78abad98a WatchSource:0}: Error finding container 7aa538e917dffa1ae833a4c6babe36cee8befcea9012b59807c38fa78abad98a: Status 404 returned error can't find the container with id 7aa538e917dffa1ae833a4c6babe36cee8befcea9012b59807c38fa78abad98a Jul 06 17:40:33.793125 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:33.793107 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9530b52cc90d833d2a92ae3eb83d4cd.slice/crio-971f5749248e745f0830d5df27f015a4c56bfd65366c23b8a2f84a212e5ec7c2 WatchSource:0}: Error finding container 971f5749248e745f0830d5df27f015a4c56bfd65366c23b8a2f84a212e5ec7c2: Status 404 returned error can't find the container with id 971f5749248e745f0830d5df27f015a4c56bfd65366c23b8a2f84a212e5ec7c2 Jul 06 17:40:33.799469 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.799452 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:40:33.808083 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.808047 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" event={"ID":"eddb2e3f65553b7b2293a5bad4aec16a","Type":"ContainerStarted","Data":"7aa538e917dffa1ae833a4c6babe36cee8befcea9012b59807c38fa78abad98a"} Jul 06 17:40:33.809004 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.808984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal" event={"ID":"d9530b52cc90d833d2a92ae3eb83d4cd","Type":"ContainerStarted","Data":"971f5749248e745f0830d5df27f015a4c56bfd65366c23b8a2f84a212e5ec7c2"} Jul 06 17:40:33.877185 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-hostroot\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.877185 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-kubelet\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.877185 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-etc-openvswitch\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.877185 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-run-openvswitch\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.877185 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-modprobe-d\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-kubernetes\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkb8\" (UniqueName: \"kubernetes.io/projected/7b7165f3-594c-47cd-b186-b47db2cafefe-kube-api-access-8xkb8\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-kubelet\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877225 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-hostroot\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-socket-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-var-lib-cni-multus\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-kubernetes\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877228 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-etc-openvswitch\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm8d\" (UniqueName: \"kubernetes.io/projected/c70be7ac-b3e8-486e-8013-06c82f36ba37-kube-api-access-chm8d\") pod \"iptables-alerter-hwwvq\" (UID: \"c70be7ac-b3e8-486e-8013-06c82f36ba37\") " pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-modprobe-d\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877326 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-run-openvswitch\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhswr\" (UniqueName: \"kubernetes.io/projected/6f08132d-2a61-4afc-b235-98fe6694c5cb-kube-api-access-jhswr\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877344 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-var-lib-cni-multus\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-socket-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-run-netns\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.877526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-cni-binary-copy\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-run-netns\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-cni-binary-copy\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b7165f3-594c-47cd-b186-b47db2cafefe-ovnkube-config\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-sys\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-var-lib-kubelet\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-tuned\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-system-cni-dir\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877624 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-sys\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-os-release\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-var-lib-kubelet\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877684 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-system-cni-dir\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-os-release\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-lib-modules\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-socket-dir-parent\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-etc-kubernetes\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-systemd\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.878335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-lib-modules\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-run-netns\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-etc-kubernetes\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-socket-dir-parent\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf8vg\" (UniqueName: \"kubernetes.io/projected/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-kube-api-access-lf8vg\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-run-netns\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-sysctl-conf\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877902 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-systemd\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-var-lib-cni-bin\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-var-lib-openvswitch\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-node-log\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.877998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b7165f3-594c-47cd-b186-b47db2cafefe-ovn-node-metrics-cert\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-var-lib-cni-bin\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d37167cf-1773-4b70-a0cd-7b1f84c45439-agent-certs\") pod \"konnectivity-agent-bgkx2\" (UID: \"d37167cf-1773-4b70-a0cd-7b1f84c45439\") " pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878048 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-var-lib-openvswitch\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878061 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-cni-binary-copy\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-sysctl-d\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.879194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878091 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-host\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878093 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-cni-binary-copy\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878100 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b7165f3-594c-47cd-b186-b47db2cafefe-ovnkube-config\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c70be7ac-b3e8-486e-8013-06c82f36ba37-host-slash\") pod \"iptables-alerter-hwwvq\" (UID: \"c70be7ac-b3e8-486e-8013-06c82f36ba37\") " pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-sysctl-conf\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.877976 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-node-log\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878182 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-systemd-units\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-host\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.878188 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:40:34.378170755 +0000 UTC m=+2.088055285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-systemd-units\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-sysctl-d\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-sys-fs\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c70be7ac-b3e8-486e-8013-06c82f36ba37-host-slash\") pod \"iptables-alerter-hwwvq\" (UID: \"c70be7ac-b3e8-486e-8013-06c82f36ba37\") " pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-run-k8s-cni-cncf-io\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-slash\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878272 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-sys-fs\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.880035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-registration-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-run-k8s-cni-cncf-io\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pms2\" (UniqueName: \"kubernetes.io/projected/620c49b1-4dd3-413a-8fdc-5531058b83b0-kube-api-access-5pms2\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878318 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-slash\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-registration-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/850ea1b7-2642-4951-9c4e-dedc749fa546-tmp\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxrgd\" (UniqueName: \"kubernetes.io/projected/850ea1b7-2642-4951-9c4e-dedc749fa546-kube-api-access-cxrgd\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-os-release\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdkpv\" (UniqueName: \"kubernetes.io/projected/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-kube-api-access-gdkpv\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-var-lib-kubelet\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-conf-dir\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-run-ovn-kubernetes\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878586 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-run-ovn-kubernetes\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-var-lib-kubelet\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878664 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-conf-dir\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-sysconfig\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.880707 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878704 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-os-release\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-run\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878754 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-sysconfig\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-cnibin\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-daemon-config\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878827 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/850ea1b7-2642-4951-9c4e-dedc749fa546-run\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-cnibin\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-run-ovn\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-run-ovn\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-log-socket\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-log-socket\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-cnibin\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.878993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-cnibin\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-system-cni-dir\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c70be7ac-b3e8-486e-8013-06c82f36ba37-iptables-alerter-script\") pod \"iptables-alerter-hwwvq\" (UID: \"c70be7ac-b3e8-486e-8013-06c82f36ba37\") " pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.881169 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-cni-netd\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d37167cf-1773-4b70-a0cd-7b1f84c45439-konnectivity-ca\") pod \"konnectivity-agent-bgkx2\" (UID: \"d37167cf-1773-4b70-a0cd-7b1f84c45439\") " pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-run-multus-certs\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-run-systemd\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b7165f3-594c-47cd-b186-b47db2cafefe-ovnkube-script-lib\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879336 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-daemon-config\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-device-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879406 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-device-dir\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879407 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-host-run-multus-certs\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879457 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-system-cni-dir\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-cni-netd\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879576 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.881721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-cni-dir\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-cni-bin\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b7165f3-594c-47cd-b186-b47db2cafefe-env-overrides\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c70be7ac-b3e8-486e-8013-06c82f36ba37-iptables-alerter-script\") pod \"iptables-alerter-hwwvq\" (UID: \"c70be7ac-b3e8-486e-8013-06c82f36ba37\") " pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.879944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b7165f3-594c-47cd-b186-b47db2cafefe-ovnkube-script-lib\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.880048 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d37167cf-1773-4b70-a0cd-7b1f84c45439-konnectivity-ca\") pod \"konnectivity-agent-bgkx2\" (UID: \"d37167cf-1773-4b70-a0cd-7b1f84c45439\") " pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.880056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-host-cni-bin\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.880082 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b7165f3-594c-47cd-b186-b47db2cafefe-env-overrides\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.880091 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b7165f3-594c-47cd-b186-b47db2cafefe-run-systemd\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.880139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/620c49b1-4dd3-413a-8fdc-5531058b83b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.880124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-multus-cni-dir\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.880636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b7165f3-594c-47cd-b186-b47db2cafefe-ovn-node-metrics-cert\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.880716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/850ea1b7-2642-4951-9c4e-dedc749fa546-etc-tuned\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.880839 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d37167cf-1773-4b70-a0cd-7b1f84c45439-agent-certs\") pod \"konnectivity-agent-bgkx2\" (UID: \"d37167cf-1773-4b70-a0cd-7b1f84c45439\") " pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:33.882179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.881647 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/850ea1b7-2642-4951-9c4e-dedc749fa546-tmp\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.884975 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.884959 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:40:33.887661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.887635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf8vg\" (UniqueName: \"kubernetes.io/projected/3f0237a1-6da5-4e4e-9b5b-293673b0e71f-kube-api-access-lf8vg\") pod \"multus-dgxth\" (UID: \"3f0237a1-6da5-4e4e-9b5b-293673b0e71f\") " pod="openshift-multus/multus-dgxth" Jul 06 17:40:33.887661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.887637 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhswr\" (UniqueName: \"kubernetes.io/projected/6f08132d-2a61-4afc-b235-98fe6694c5cb-kube-api-access-jhswr\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:33.887822 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.887786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pms2\" (UniqueName: \"kubernetes.io/projected/620c49b1-4dd3-413a-8fdc-5531058b83b0-kube-api-access-5pms2\") pod \"aws-ebs-csi-driver-node-99lgq\" (UID: \"620c49b1-4dd3-413a-8fdc-5531058b83b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:33.888382 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.888363 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xkb8\" (UniqueName: \"kubernetes.io/projected/7b7165f3-594c-47cd-b186-b47db2cafefe-kube-api-access-8xkb8\") pod \"ovnkube-node-d2q89\" (UID: \"7b7165f3-594c-47cd-b186-b47db2cafefe\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:33.888492 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.888478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chm8d\" (UniqueName: \"kubernetes.io/projected/c70be7ac-b3e8-486e-8013-06c82f36ba37-kube-api-access-chm8d\") pod \"iptables-alerter-hwwvq\" (UID: \"c70be7ac-b3e8-486e-8013-06c82f36ba37\") " pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:33.889444 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.889428 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:40:33.889481 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.889451 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:40:33.889481 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.889466 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mskwz for pod openshift-network-diagnostics/network-check-target-wxvxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:33.889561 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:33.889529 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz podName:ae88b815-4a5a-4570-b590-4e4199d15ea5 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:34.389512723 +0000 UTC m=+2.099397269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mskwz" (UniqueName: "kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz") pod "network-check-target-wxvxk" (UID: "ae88b815-4a5a-4570-b590-4e4199d15ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:33.891167 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.891148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxrgd\" (UniqueName: \"kubernetes.io/projected/850ea1b7-2642-4951-9c4e-dedc749fa546-kube-api-access-cxrgd\") pod \"tuned-c458d\" (UID: \"850ea1b7-2642-4951-9c4e-dedc749fa546\") " pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:33.891246 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.891220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdkpv\" (UniqueName: \"kubernetes.io/projected/9d0f98f4-e639-4f1d-9f96-6b2e38518ce0-kube-api-access-gdkpv\") pod \"multus-additional-cni-plugins-v8tkt\" (UID: \"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0\") " pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:33.991180 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:33.991146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6kpx2" Jul 06 17:40:34.000300 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:34.000270 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519470ee_d1c3_4103_9d2f_a0930c92c9d8.slice/crio-8e5ec403153b30b431ebadd784f9a4c6456138b6611db7e731077940289586b9 WatchSource:0}: Error finding container 8e5ec403153b30b431ebadd784f9a4c6456138b6611db7e731077940289586b9: Status 404 returned error can't find the container with id 8e5ec403153b30b431ebadd784f9a4c6456138b6611db7e731077940289586b9 Jul 06 17:40:34.008516 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.008496 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dgxth" Jul 06 17:40:34.016088 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:34.016058 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0237a1_6da5_4e4e_9b5b_293673b0e71f.slice/crio-6d85800837b79ee044b45b9db50693c7e0b1b7b6d3d02bf16f35458e8ea70d49 WatchSource:0}: Error finding container 6d85800837b79ee044b45b9db50693c7e0b1b7b6d3d02bf16f35458e8ea70d49: Status 404 returned error can't find the container with id 6d85800837b79ee044b45b9db50693c7e0b1b7b6d3d02bf16f35458e8ea70d49 Jul 06 17:40:34.031301 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.031280 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rkqhf" Jul 06 17:40:34.038499 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:34.038480 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85ae0f7_be74_4213_a011_2ca424f86604.slice/crio-29378ea6033e500f48224dc3213189a4e9fb18329e23fdaf79649c6931d001f2 WatchSource:0}: Error finding container 29378ea6033e500f48224dc3213189a4e9fb18329e23fdaf79649c6931d001f2: Status 404 returned error can't find the container with id 29378ea6033e500f48224dc3213189a4e9fb18329e23fdaf79649c6931d001f2 Jul 06 17:40:34.045366 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.045349 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:40:34.052179 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:34.052159 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7165f3_594c_47cd_b186_b47db2cafefe.slice/crio-fc619443cffc77525ac0d08fc79ca11e15153326095115860409cdda09d28077 WatchSource:0}: Error finding container fc619443cffc77525ac0d08fc79ca11e15153326095115860409cdda09d28077: Status 404 returned error can't find the container with id fc619443cffc77525ac0d08fc79ca11e15153326095115860409cdda09d28077 Jul 06 17:40:34.063506 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.063489 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" Jul 06 17:40:34.072416 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:34.072385 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620c49b1_4dd3_413a_8fdc_5531058b83b0.slice/crio-fcc3b5fe86efdee3f0a14ab3b37846fff487ba914596c259bdcb87fa8ff01870 WatchSource:0}: Error finding container fcc3b5fe86efdee3f0a14ab3b37846fff487ba914596c259bdcb87fa8ff01870: Status 404 returned error can't find the container with id fcc3b5fe86efdee3f0a14ab3b37846fff487ba914596c259bdcb87fa8ff01870 Jul 06 17:40:34.086233 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.086211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" Jul 06 17:40:34.091226 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.091209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:34.093365 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:34.093342 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0f98f4_e639_4f1d_9f96_6b2e38518ce0.slice/crio-8425dfb4b9a8108387e0bf031e35f358fcc9fa7d5a508a2d0144e0697bf7a60a WatchSource:0}: Error finding container 8425dfb4b9a8108387e0bf031e35f358fcc9fa7d5a508a2d0144e0697bf7a60a: Status 404 returned error can't find the container with id 8425dfb4b9a8108387e0bf031e35f358fcc9fa7d5a508a2d0144e0697bf7a60a Jul 06 17:40:34.096753 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.096733 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c458d" Jul 06 17:40:34.098109 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:34.098090 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37167cf_1773_4b70_a0cd_7b1f84c45439.slice/crio-17f302c6c413c6d092f2d51dadd6d88153bb4573b1ca25b848cb640cafb06d6f WatchSource:0}: Error finding container 17f302c6c413c6d092f2d51dadd6d88153bb4573b1ca25b848cb640cafb06d6f: Status 404 returned error can't find the container with id 17f302c6c413c6d092f2d51dadd6d88153bb4573b1ca25b848cb640cafb06d6f Jul 06 17:40:34.101271 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.101255 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwwvq" Jul 06 17:40:34.105195 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:34.105174 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850ea1b7_2642_4951_9c4e_dedc749fa546.slice/crio-7dc3c0d28764bec31e84b8d038f62ee53bced9c7f190df043d4392dc98b77b3e WatchSource:0}: Error finding container 7dc3c0d28764bec31e84b8d038f62ee53bced9c7f190df043d4392dc98b77b3e: Status 404 returned error can't find the container with id 7dc3c0d28764bec31e84b8d038f62ee53bced9c7f190df043d4392dc98b77b3e Jul 06 17:40:34.109905 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:40:34.109888 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70be7ac_b3e8_486e_8013_06c82f36ba37.slice/crio-7403781c5adeb6939c0b28e85cf28ced22f911de758d49711727ec91f4774cd8 WatchSource:0}: Error finding container 7403781c5adeb6939c0b28e85cf28ced22f911de758d49711727ec91f4774cd8: Status 404 returned error can't find the container with id 7403781c5adeb6939c0b28e85cf28ced22f911de758d49711727ec91f4774cd8 Jul 06 17:40:34.278923 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.278819 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:40:34.281439 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.281411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:34.281592 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:34.281572 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:34.281650 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:34.281637 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret podName:3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc nodeName:}" failed. No retries permitted until 2026-07-06 17:40:35.281617652 +0000 UTC m=+2.991502182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret") pod "global-pull-secret-syncer-z7cwn" (UID: "3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:34.383104 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.382708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:34.383104 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:34.382886 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:34.383104 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:34.382962 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:40:35.382944056 +0000 UTC m=+3.092828589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:34.484400 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.483723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:34.484400 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:34.483983 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:40:34.484400 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:34.484008 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:40:34.484400 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:34.484021 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mskwz for pod openshift-network-diagnostics/network-check-target-wxvxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:34.484400 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:34.484079 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz podName:ae88b815-4a5a-4570-b590-4e4199d15ea5 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:35.484060982 +0000 UTC m=+3.193945527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mskwz" (UniqueName: "kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz") pod "network-check-target-wxvxk" (UID: "ae88b815-4a5a-4570-b590-4e4199d15ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:34.711631 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.711509 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:35:33 +0000 UTC" deadline="2028-04-19 04:58:12.66928913 +0000 UTC" Jul 06 17:40:34.711631 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.711585 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15659h17m37.957708108s" Jul 06 17:40:34.808832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.808720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:34.809032 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:34.808841 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:34.839177 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.839133 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwwvq" event={"ID":"c70be7ac-b3e8-486e-8013-06c82f36ba37","Type":"ContainerStarted","Data":"7403781c5adeb6939c0b28e85cf28ced22f911de758d49711727ec91f4774cd8"} Jul 06 17:40:34.860354 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.860317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c458d" event={"ID":"850ea1b7-2642-4951-9c4e-dedc749fa546","Type":"ContainerStarted","Data":"7dc3c0d28764bec31e84b8d038f62ee53bced9c7f190df043d4392dc98b77b3e"} Jul 06 17:40:34.882983 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.882943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" event={"ID":"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0","Type":"ContainerStarted","Data":"8425dfb4b9a8108387e0bf031e35f358fcc9fa7d5a508a2d0144e0697bf7a60a"} Jul 06 17:40:34.899759 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.899565 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:40:34.912102 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.911968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" event={"ID":"7b7165f3-594c-47cd-b186-b47db2cafefe","Type":"ContainerStarted","Data":"fc619443cffc77525ac0d08fc79ca11e15153326095115860409cdda09d28077"} Jul 06 17:40:34.930711 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.930675 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6kpx2" event={"ID":"519470ee-d1c3-4103-9d2f-a0930c92c9d8","Type":"ContainerStarted","Data":"8e5ec403153b30b431ebadd784f9a4c6456138b6611db7e731077940289586b9"} Jul 06 17:40:34.946173 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.946141 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bgkx2" event={"ID":"d37167cf-1773-4b70-a0cd-7b1f84c45439","Type":"ContainerStarted","Data":"17f302c6c413c6d092f2d51dadd6d88153bb4573b1ca25b848cb640cafb06d6f"} Jul 06 17:40:34.957374 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.957282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" event={"ID":"620c49b1-4dd3-413a-8fdc-5531058b83b0","Type":"ContainerStarted","Data":"fcc3b5fe86efdee3f0a14ab3b37846fff487ba914596c259bdcb87fa8ff01870"} Jul 06 17:40:34.968622 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.968529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rkqhf" event={"ID":"e85ae0f7-be74-4213-a011-2ca424f86604","Type":"ContainerStarted","Data":"29378ea6033e500f48224dc3213189a4e9fb18329e23fdaf79649c6931d001f2"} Jul 06 17:40:34.980527 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:34.980407 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dgxth" event={"ID":"3f0237a1-6da5-4e4e-9b5b-293673b0e71f","Type":"ContainerStarted","Data":"6d85800837b79ee044b45b9db50693c7e0b1b7b6d3d02bf16f35458e8ea70d49"} Jul 06 17:40:35.290658 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:35.290568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:35.290821 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.290738 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:35.290821 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.290809 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret podName:3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc nodeName:}" failed. No retries permitted until 2026-07-06 17:40:37.290790994 +0000 UTC m=+5.000675529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret") pod "global-pull-secret-syncer-z7cwn" (UID: "3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:35.391971 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:35.391396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:35.391971 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.391562 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:35.391971 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.391624 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:40:37.391607092 +0000 UTC m=+5.101491624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:35.493289 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:35.492662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:35.493289 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.492849 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:40:35.493289 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.492869 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:40:35.493289 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.492882 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mskwz for pod openshift-network-diagnostics/network-check-target-wxvxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:35.493289 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.492941 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz podName:ae88b815-4a5a-4570-b590-4e4199d15ea5 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:37.492922781 +0000 UTC m=+5.202807317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mskwz" (UniqueName: "kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz") pod "network-check-target-wxvxk" (UID: "ae88b815-4a5a-4570-b590-4e4199d15ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:35.712059 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:35.711969 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:35:33 +0000 UTC" deadline="2028-02-28 15:35:39.815320345 +0000 UTC" Jul 06 17:40:35.712059 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:35.712009 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14445h55m4.103315567s" Jul 06 17:40:35.806675 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:35.806645 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:35.806847 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.806772 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:35.806914 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:35.806847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:35.806966 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:35.806931 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:36.019895 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:36.019633 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:40:36.809510 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:36.808999 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:36.809510 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:36.809127 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:37.311298 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:37.311264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:37.311467 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.311404 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:37.311467 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.311464 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret podName:3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc nodeName:}" failed. No retries permitted until 2026-07-06 17:40:41.311447027 +0000 UTC m=+9.021331563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret") pod "global-pull-secret-syncer-z7cwn" (UID: "3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:37.412695 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:37.412660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:37.412844 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.412820 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:37.412918 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.412901 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:40:41.412880517 +0000 UTC m=+9.122765063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:37.513471 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:37.513428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:37.513675 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.513664 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:40:37.513755 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.513683 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:40:37.513755 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.513694 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mskwz for pod openshift-network-diagnostics/network-check-target-wxvxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:37.513755 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.513751 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz podName:ae88b815-4a5a-4570-b590-4e4199d15ea5 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:41.513733201 +0000 UTC m=+9.223617765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mskwz" (UniqueName: "kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz") pod "network-check-target-wxvxk" (UID: "ae88b815-4a5a-4570-b590-4e4199d15ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:37.806773 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:37.806668 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:37.806896 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.806811 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:37.806896 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:37.806831 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:37.806974 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:37.806923 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:38.807205 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:38.806640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:38.807205 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:38.806765 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:39.806509 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:39.806476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:39.806698 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:39.806523 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:39.806698 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:39.806630 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:39.806810 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:39.806761 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:40.807090 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:40.806230 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:40.807090 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:40.806859 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:41.342753 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:41.342721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:41.342923 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.342894 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:41.342981 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.342969 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret podName:3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc nodeName:}" failed. No retries permitted until 2026-07-06 17:40:49.342949802 +0000 UTC m=+17.052834338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret") pod "global-pull-secret-syncer-z7cwn" (UID: "3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:41.443416 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:41.443376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:41.443621 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.443524 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:41.443621 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.443603 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:40:49.443587331 +0000 UTC m=+17.153471865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:41.544327 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:41.544283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:41.544490 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.544471 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:40:41.544563 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.544495 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:40:41.544563 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.544505 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mskwz for pod openshift-network-diagnostics/network-check-target-wxvxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:41.544676 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.544575 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz podName:ae88b815-4a5a-4570-b590-4e4199d15ea5 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:49.544543142 +0000 UTC m=+17.254427671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mskwz" (UniqueName: "kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz") pod "network-check-target-wxvxk" (UID: "ae88b815-4a5a-4570-b590-4e4199d15ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:41.806653 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:41.805950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:41.806653 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.806064 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:41.806653 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:41.806401 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:41.806653 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:41.806543 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:42.807390 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:42.807306 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:42.807844 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:42.807424 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:43.806542 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:43.806455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:43.806748 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:43.806626 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:43.806748 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:43.806713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:43.806871 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:43.806821 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:44.806818 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:44.806773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:44.807273 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:44.806922 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:45.806162 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:45.806128 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:45.806162 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:45.806152 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:45.806354 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:45.806243 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:45.806405 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:45.806385 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:46.805920 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:46.805879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:46.806383 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:46.805994 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:47.805767 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:47.805722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:47.805934 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:47.805773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:47.805934 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:47.805842 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:47.806338 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:47.805939 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:48.806248 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:48.806213 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:48.806708 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:48.806323 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:49.404263 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:49.404232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:49.404420 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.404363 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:49.404489 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.404423 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret podName:3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc nodeName:}" failed. No retries permitted until 2026-07-06 17:41:05.404406181 +0000 UTC m=+33.114290722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret") pod "global-pull-secret-syncer-z7cwn" (UID: "3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:40:49.504839 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:49.504807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:49.504952 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.504935 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:49.505275 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.505256 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:41:05.504975683 +0000 UTC m=+33.214860214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:40:49.605977 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:49.605948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:49.606154 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.606135 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:40:49.606206 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.606158 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:40:49.606206 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.606170 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mskwz for pod openshift-network-diagnostics/network-check-target-wxvxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:49.606291 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.606222 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz podName:ae88b815-4a5a-4570-b590-4e4199d15ea5 nodeName:}" failed. No retries permitted until 2026-07-06 17:41:05.606207574 +0000 UTC m=+33.316092105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mskwz" (UniqueName: "kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz") pod "network-check-target-wxvxk" (UID: "ae88b815-4a5a-4570-b590-4e4199d15ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:40:49.805997 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:49.805967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:49.806127 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:49.805981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:49.806127 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.806089 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:49.806251 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:49.806193 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:50.806176 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:50.806147 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:50.806595 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:50.806250 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:51.806809 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:51.806606 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:51.807199 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:51.806606 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:51.807199 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:51.806912 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:51.807199 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:51.806968 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:52.806730 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:52.806692 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:52.806916 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:52.806806 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:53.806446 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:53.806417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:53.806601 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:53.806543 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:53.806601 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:53.806591 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:53.806679 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:53.806658 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:54.806572 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:54.806377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:54.807106 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:54.806680 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:55.024800 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.024772 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dgxth" event={"ID":"3f0237a1-6da5-4e4e-9b5b-293673b0e71f","Type":"ContainerStarted","Data":"3b146d81aab5e37aa2c02da9e736694a01f8dd693741f0e81994127f825e8693"} Jul 06 17:40:55.026649 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.026624 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c458d" event={"ID":"850ea1b7-2642-4951-9c4e-dedc749fa546","Type":"ContainerStarted","Data":"542186cc12c379770bf4a2e5f3a097d9253d63a14eadd11a7f0ad4dff7874100"} Jul 06 17:40:55.029610 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.029574 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" event={"ID":"7b7165f3-594c-47cd-b186-b47db2cafefe","Type":"ContainerStarted","Data":"d5a08b595f146f7847a853e7461eb2a67d87aef4b84d30726eb9cadb478d0b86"} Jul 06 17:40:55.029700 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.029636 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" event={"ID":"7b7165f3-594c-47cd-b186-b47db2cafefe","Type":"ContainerStarted","Data":"609274714bce8e3c248ac35f78c27232631a6b101ca7d06ec142394bda347f79"} Jul 06 17:40:55.029700 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.029682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" event={"ID":"7b7165f3-594c-47cd-b186-b47db2cafefe","Type":"ContainerStarted","Data":"a013384d1db9e34efa605d759b7445cb0a3b3a0b7e1d2281d2ca4f34fa7842e5"} Jul 06 17:40:55.029784 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.029710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" event={"ID":"7b7165f3-594c-47cd-b186-b47db2cafefe","Type":"ContainerStarted","Data":"513e3f439cd5750e8d77ff394cf90b9a81708381cbb7e8af780e9ec42ec1a677"} Jul 06 17:40:55.029784 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.029737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" event={"ID":"7b7165f3-594c-47cd-b186-b47db2cafefe","Type":"ContainerStarted","Data":"81846c38eed5473983b78fb999633349128545e937f619518c878f1340d7c22f"} Jul 06 17:40:55.029784 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.029763 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" event={"ID":"7b7165f3-594c-47cd-b186-b47db2cafefe","Type":"ContainerStarted","Data":"2b3f90a8c94026854a205d2a9024098523b204b4f42e546b710b04bb5e3e098a"} Jul 06 17:40:55.030970 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.030948 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal" event={"ID":"d9530b52cc90d833d2a92ae3eb83d4cd","Type":"ContainerStarted","Data":"e97cf65eb2ee727d46b2946ef0ed5d46b9545b9afe67c5ba0417346d044f9d95"} Jul 06 17:40:55.058799 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.056322 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-100.ec2.internal" podStartSLOduration=22.056305847 podStartE2EDuration="22.056305847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:55.055407635 +0000 UTC m=+22.765292188" watchObservedRunningTime="2026-07-06 17:40:55.056305847 +0000 UTC m=+22.766190399" Jul 06 17:40:55.058799 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.057406 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dgxth" podStartSLOduration=2.884069619 podStartE2EDuration="23.057387809s" totalImagesPullingTime="20.17331819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:55.041603432 +0000 UTC m=+22.751487983" watchObservedRunningTime="2026-07-06 17:40:55.057387809 +0000 UTC m=+22.767272362" Jul 06 17:40:55.074229 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.073672 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c458d" podStartSLOduration=3.003593951 podStartE2EDuration="23.073653455s" totalImagesPullingTime="20.070059504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:55.07317848 +0000 UTC m=+22.783063049" watchObservedRunningTime="2026-07-06 17:40:55.073653455 +0000 UTC m=+22.783538008" Jul 06 17:40:55.806195 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.806156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:55.806498 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:55.806156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:55.806498 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:55.806279 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:55.806498 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:55.806369 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:56.034405 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.034364 2577 generic.go:356] "Generic (PLEG): container finished" podID="eddb2e3f65553b7b2293a5bad4aec16a" containerID="feaa0998553dd0b67d767af796ed4d82ca50fb5e77cc33c3b81d15b519aacf9e" exitCode=0 Jul 06 17:40:56.034621 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.034443 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" event={"ID":"eddb2e3f65553b7b2293a5bad4aec16a","Type":"ContainerDied","Data":"feaa0998553dd0b67d767af796ed4d82ca50fb5e77cc33c3b81d15b519aacf9e"} Jul 06 17:40:56.036061 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.036034 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwwvq" event={"ID":"c70be7ac-b3e8-486e-8013-06c82f36ba37","Type":"ContainerStarted","Data":"8078a88d6847cc92aa06a629d63343a81f17a7514abe820ef833d1a1e98e6d2c"} Jul 06 17:40:56.037526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.037507 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d0f98f4-e639-4f1d-9f96-6b2e38518ce0" containerID="86179762ba64eb96b242593e6fb543f555818507b0494f8da8a4749d91ac005f" exitCode=0 Jul 06 17:40:56.037639 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.037583 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" event={"ID":"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0","Type":"ContainerDied","Data":"86179762ba64eb96b242593e6fb543f555818507b0494f8da8a4749d91ac005f"} Jul 06 17:40:56.039125 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.039105 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6kpx2" event={"ID":"519470ee-d1c3-4103-9d2f-a0930c92c9d8","Type":"ContainerStarted","Data":"a299d96abf7bbabd89b78707d02c402a6a50aee2611cce600fc9735c8241b150"} Jul 06 17:40:56.040661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.040637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bgkx2" event={"ID":"d37167cf-1773-4b70-a0cd-7b1f84c45439","Type":"ContainerStarted","Data":"eb7cf73b99eeefa692517bba8dc6efd6c18a6b41b1b9670e1b4055eb3da19a59"} Jul 06 17:40:56.042121 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.042101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" event={"ID":"620c49b1-4dd3-413a-8fdc-5531058b83b0","Type":"ContainerStarted","Data":"f1e30dd1b23fcad0bcf891522965b5dbafed79bd9d096c16ff4dc022581a7e91"} Jul 06 17:40:56.043365 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.043337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rkqhf" event={"ID":"e85ae0f7-be74-4213-a011-2ca424f86604","Type":"ContainerStarted","Data":"2b01f6576bb6a18c232e5d698d8cd856590e4c7123241c2a90076e1b90b2952d"} Jul 06 17:40:56.086327 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.086069 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bgkx2" podStartSLOduration=12.480793068 podStartE2EDuration="24.086054826s" totalImagesPullingTime="11.605261758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:56.086049171 +0000 UTC m=+23.795933723" watchObservedRunningTime="2026-07-06 17:40:56.086054826 +0000 UTC m=+23.795939378" Jul 06 17:40:56.102900 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.102855 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hwwvq" podStartSLOduration=8.835654493 podStartE2EDuration="24.102840356s" totalImagesPullingTime="15.267185863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:56.102478602 +0000 UTC m=+23.812363167" watchObservedRunningTime="2026-07-06 17:40:56.102840356 +0000 UTC m=+23.812724940" Jul 06 17:40:56.118210 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.118163 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6kpx2" podStartSLOduration=4.364006877 podStartE2EDuration="24.118151995s" totalImagesPullingTime="19.754145118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:56.118011826 +0000 UTC m=+23.827896378" watchObservedRunningTime="2026-07-06 17:40:56.118151995 +0000 UTC m=+23.828036546" Jul 06 17:40:56.131886 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.131846 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rkqhf" podStartSLOduration=4.015046 podStartE2EDuration="24.131835743s" totalImagesPullingTime="20.116789743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:56.131481431 +0000 UTC m=+23.841365994" watchObservedRunningTime="2026-07-06 17:40:56.131835743 +0000 UTC m=+23.841720295" Jul 06 17:40:56.540878 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.540853 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 17:40:56.742542 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.742404 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T17:40:56.540873999Z","UUID":"943ff350-4eec-477e-8fa5-591df1c99d0f","Handler":null,"Name":"","Endpoint":""} Jul 06 17:40:56.743829 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.743811 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 17:40:56.743933 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.743846 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 17:40:56.806451 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:56.806424 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:56.806615 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:56.806528 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:57.047252 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:57.047167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" event={"ID":"620c49b1-4dd3-413a-8fdc-5531058b83b0","Type":"ContainerStarted","Data":"ddb562f753dc6fdca738dbb7e325f96e00c80fe233e58100965f2af6f2f9a2bb"} Jul 06 17:40:57.049182 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:57.049131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" event={"ID":"eddb2e3f65553b7b2293a5bad4aec16a","Type":"ContainerStarted","Data":"47dd6f477847f8a65b44576af48539e907ee6a8f69144c240c0888f407851866"} Jul 06 17:40:57.064274 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:57.064232 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-100.ec2.internal" podStartSLOduration=24.064217598 podStartE2EDuration="24.064217598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:57.063977833 +0000 UTC m=+24.773862386" watchObservedRunningTime="2026-07-06 17:40:57.064217598 +0000 UTC m=+24.774102154" Jul 06 17:40:57.805914 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:57.805878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:57.806094 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:57.805893 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:57.806094 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:57.806011 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:57.806094 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:57.806048 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:40:58.035528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:58.035445 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:58.036155 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:58.036136 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:58.053455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:58.053426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" event={"ID":"620c49b1-4dd3-413a-8fdc-5531058b83b0","Type":"ContainerStarted","Data":"139a4f67ff605438f662184e9d413ee897c49a8d00fd0aa295210423f65a756c"} Jul 06 17:40:58.056772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:58.056743 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" event={"ID":"7b7165f3-594c-47cd-b186-b47db2cafefe","Type":"ContainerStarted","Data":"746d45f1c1963284866f33c303f27962a70ffee74dad0e73a4bccddeabb4c5a0"} Jul 06 17:40:58.057118 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:58.057069 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:58.057334 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:58.057318 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bgkx2" Jul 06 17:40:58.070042 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:58.070002 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99lgq" podStartSLOduration=3.6092007710000003 podStartE2EDuration="26.069987704s" totalImagesPullingTime="22.460786933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:58.069709587 +0000 UTC m=+25.779594140" watchObservedRunningTime="2026-07-06 17:40:58.069987704 +0000 UTC m=+25.779872256" Jul 06 17:40:58.806565 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:58.806525 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:40:58.806727 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:58.806648 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:40:59.806597 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:59.806411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:40:59.807143 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:40:59.806444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:40:59.807143 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:59.806686 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:40:59.807143 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:40:59.806763 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:41:00.064604 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:00.064524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" event={"ID":"7b7165f3-594c-47cd-b186-b47db2cafefe","Type":"ContainerStarted","Data":"1db02b67a608238fd17db54d6695a101cbaf357fb31d0e01547de53ac7e67720"} Jul 06 17:41:00.090324 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:00.090279 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" podStartSLOduration=7.737531711 podStartE2EDuration="28.090265312s" totalImagesPullingTime="20.352733601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:41:00.088390144 +0000 UTC m=+27.798274722" watchObservedRunningTime="2026-07-06 17:41:00.090265312 +0000 UTC m=+27.800149863" Jul 06 17:41:00.805924 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:00.805850 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:00.806069 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:00.805975 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:41:01.067834 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.067763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:41:01.068393 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.067849 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:41:01.068393 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.067892 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:41:01.084634 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.084462 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:41:01.085312 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.085290 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:41:01.390097 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.390004 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7cwn"] Jul 06 17:41:01.390243 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.390162 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:41:01.390297 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:01.390259 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:41:01.393452 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.393386 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wxvxk"] Jul 06 17:41:01.393708 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.393685 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:01.393832 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:01.393784 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:41:01.394227 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.394199 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7jgm5"] Jul 06 17:41:01.394313 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:01.394294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:41:01.394419 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:01.394398 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:41:02.807121 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:02.806950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:41:02.807561 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:02.807180 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:41:02.807561 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:02.807046 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:02.807561 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:02.807246 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:41:02.807561 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:02.807030 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:41:02.807561 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:02.807327 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:41:03.073580 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:03.073484 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d0f98f4-e639-4f1d-9f96-6b2e38518ce0" containerID="c01fdea2bc13fb51d9464639ef63ceaf1bd2f680524f58480c7a70a1fea4025a" exitCode=0 Jul 06 17:41:03.073580 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:03.073541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" event={"ID":"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0","Type":"ContainerDied","Data":"c01fdea2bc13fb51d9464639ef63ceaf1bd2f680524f58480c7a70a1fea4025a"} Jul 06 17:41:04.077850 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:04.077817 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d0f98f4-e639-4f1d-9f96-6b2e38518ce0" containerID="3f08ec9844eddcd75e61803623a8ae81973bf1a71b99f9840f53afa2201e58d8" exitCode=0 Jul 06 17:41:04.078244 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:04.077877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" event={"ID":"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0","Type":"ContainerDied","Data":"3f08ec9844eddcd75e61803623a8ae81973bf1a71b99f9840f53afa2201e58d8"} Jul 06 17:41:04.805740 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:04.805700 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:41:04.805931 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:04.805708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:41:04.805931 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:04.805819 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:41:04.805931 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:04.805897 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:41:04.806147 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:04.805945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:04.806147 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:04.806039 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:41:05.082227 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:05.082141 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d0f98f4-e639-4f1d-9f96-6b2e38518ce0" containerID="5cb9dbe4de7652cfb21dc0c434b9b0277bcbd601a748cce5a79dee5bf784fd08" exitCode=0 Jul 06 17:41:05.082227 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:05.082205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" event={"ID":"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0","Type":"ContainerDied","Data":"5cb9dbe4de7652cfb21dc0c434b9b0277bcbd601a748cce5a79dee5bf784fd08"} Jul 06 17:41:05.423665 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:05.423585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:41:05.423796 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:05.423685 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:41:05.423796 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:05.423735 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret podName:3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc nodeName:}" failed. No retries permitted until 2026-07-06 17:41:37.423722081 +0000 UTC m=+65.133606615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret") pod "global-pull-secret-syncer-z7cwn" (UID: "3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:41:05.524564 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:05.524524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:41:05.524697 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:05.524663 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:41:05.524732 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:05.524718 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:41:37.524703101 +0000 UTC m=+65.234587630 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:41:05.625823 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:05.625798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:05.625963 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:05.625907 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:41:05.625963 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:05.625923 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:41:05.625963 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:05.625932 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mskwz for pod openshift-network-diagnostics/network-check-target-wxvxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:41:05.626075 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:05.625978 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz podName:ae88b815-4a5a-4570-b590-4e4199d15ea5 nodeName:}" failed. No retries permitted until 2026-07-06 17:41:37.625963223 +0000 UTC m=+65.335847754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mskwz" (UniqueName: "kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz") pod "network-check-target-wxvxk" (UID: "ae88b815-4a5a-4570-b590-4e4199d15ea5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:41:06.260691 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:06.260660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:06.338793 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:06.338761 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:06.806325 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:06.806289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:41:06.806491 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:06.806289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:41:06.806491 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:06.806395 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:41:06.806491 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:06.806404 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:06.806685 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:06.806493 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7cwn" podUID="3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc" Jul 06 17:41:06.806685 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:06.806562 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxvxk" podUID="ae88b815-4a5a-4570-b590-4e4199d15ea5" Jul 06 17:41:08.058064 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.057978 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-100.ec2.internal" event="NodeReady" Jul 06 17:41:08.058480 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.058125 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 17:41:08.104659 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.104630 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rv48c"] Jul 06 17:41:08.124954 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.124917 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x6vm5"] Jul 06 17:41:08.125135 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.125085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.127843 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.127821 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 17:41:08.127843 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.127832 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lmt7g\"" Jul 06 17:41:08.128012 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.127826 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 17:41:08.150872 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.150848 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x6vm5"] Jul 06 17:41:08.150981 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.150883 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x6vm5" Jul 06 17:41:08.150981 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.150889 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rv48c"] Jul 06 17:41:08.153906 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.153887 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 17:41:08.153906 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.153907 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 17:41:08.154165 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.154144 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 17:41:08.154278 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.154212 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xxwrm\"" Jul 06 17:41:08.244020 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.243990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g92zt\" (UniqueName: \"kubernetes.io/projected/6a0420eb-1489-4a4e-9dfd-a29b793f797e-kube-api-access-g92zt\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.244020 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.244028 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2494827-dc7f-402b-bf10-aae6a568d847-cert\") pod \"ingress-canary-x6vm5\" (UID: \"e2494827-dc7f-402b-bf10-aae6a568d847\") " pod="openshift-ingress-canary/ingress-canary-x6vm5" Jul 06 17:41:08.244220 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.244102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0420eb-1489-4a4e-9dfd-a29b793f797e-config-volume\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.244220 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.244122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.244220 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.244144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlk4p\" (UniqueName: \"kubernetes.io/projected/e2494827-dc7f-402b-bf10-aae6a568d847-kube-api-access-hlk4p\") pod \"ingress-canary-x6vm5\" (UID: \"e2494827-dc7f-402b-bf10-aae6a568d847\") " pod="openshift-ingress-canary/ingress-canary-x6vm5" Jul 06 17:41:08.244220 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.244209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0420eb-1489-4a4e-9dfd-a29b793f797e-tmp-dir\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.345583 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.345486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0420eb-1489-4a4e-9dfd-a29b793f797e-config-volume\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.345583 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.345525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.345583 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.345566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlk4p\" (UniqueName: \"kubernetes.io/projected/e2494827-dc7f-402b-bf10-aae6a568d847-kube-api-access-hlk4p\") pod \"ingress-canary-x6vm5\" (UID: \"e2494827-dc7f-402b-bf10-aae6a568d847\") " pod="openshift-ingress-canary/ingress-canary-x6vm5" Jul 06 17:41:08.345859 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.345632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0420eb-1489-4a4e-9dfd-a29b793f797e-tmp-dir\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.345859 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:08.345663 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:41:08.345859 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.345661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g92zt\" (UniqueName: \"kubernetes.io/projected/6a0420eb-1489-4a4e-9dfd-a29b793f797e-kube-api-access-g92zt\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.345859 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.345703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2494827-dc7f-402b-bf10-aae6a568d847-cert\") pod \"ingress-canary-x6vm5\" (UID: \"e2494827-dc7f-402b-bf10-aae6a568d847\") " pod="openshift-ingress-canary/ingress-canary-x6vm5" Jul 06 17:41:08.345859 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:08.345726 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls podName:6a0420eb-1489-4a4e-9dfd-a29b793f797e nodeName:}" failed. No retries permitted until 2026-07-06 17:41:08.845707504 +0000 UTC m=+36.555592057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls") pod "dns-default-rv48c" (UID: "6a0420eb-1489-4a4e-9dfd-a29b793f797e") : secret "dns-default-metrics-tls" not found Jul 06 17:41:08.346170 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.346146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0420eb-1489-4a4e-9dfd-a29b793f797e-tmp-dir\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.346396 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.346372 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0420eb-1489-4a4e-9dfd-a29b793f797e-config-volume\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.350409 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.350257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2494827-dc7f-402b-bf10-aae6a568d847-cert\") pod \"ingress-canary-x6vm5\" (UID: \"e2494827-dc7f-402b-bf10-aae6a568d847\") " pod="openshift-ingress-canary/ingress-canary-x6vm5" Jul 06 17:41:08.355086 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.355040 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g92zt\" (UniqueName: \"kubernetes.io/projected/6a0420eb-1489-4a4e-9dfd-a29b793f797e-kube-api-access-g92zt\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.355417 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.355394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlk4p\" (UniqueName: \"kubernetes.io/projected/e2494827-dc7f-402b-bf10-aae6a568d847-kube-api-access-hlk4p\") pod \"ingress-canary-x6vm5\" (UID: \"e2494827-dc7f-402b-bf10-aae6a568d847\") " pod="openshift-ingress-canary/ingress-canary-x6vm5" Jul 06 17:41:08.458527 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.458495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x6vm5" Jul 06 17:41:08.645701 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.645667 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x6vm5"] Jul 06 17:41:08.805920 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.805889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:41:08.806099 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.805889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:08.806099 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.805889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:41:08.809263 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.809237 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 17:41:08.809389 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.809289 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 17:41:08.809471 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.809240 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gwzng\"" Jul 06 17:41:08.809581 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.809563 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 17:41:08.809658 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.809647 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 17:41:08.810780 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.810760 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vsjgr\"" Jul 06 17:41:08.848946 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:08.848888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:08.849087 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:08.849073 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:41:08.849163 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:08.849151 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls podName:6a0420eb-1489-4a4e-9dfd-a29b793f797e nodeName:}" failed. No retries permitted until 2026-07-06 17:41:09.849130178 +0000 UTC m=+37.559014720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls") pod "dns-default-rv48c" (UID: "6a0420eb-1489-4a4e-9dfd-a29b793f797e") : secret "dns-default-metrics-tls" not found Jul 06 17:41:09.656668 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:09.656634 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:09.712093 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:09.712063 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:09.857659 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:09.857627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:09.857828 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:09.857754 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:41:09.857828 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:09.857818 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls podName:6a0420eb-1489-4a4e-9dfd-a29b793f797e nodeName:}" failed. No retries permitted until 2026-07-06 17:41:11.857804344 +0000 UTC m=+39.567688874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls") pod "dns-default-rv48c" (UID: "6a0420eb-1489-4a4e-9dfd-a29b793f797e") : secret "dns-default-metrics-tls" not found Jul 06 17:41:10.170581 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:41:10.170528 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2494827_dc7f_402b_bf10_aae6a568d847.slice/crio-ac47bb92ddabf5175f7b672933fd23aea30a476591150ceff9e6a55273ee4d79 WatchSource:0}: Error finding container ac47bb92ddabf5175f7b672933fd23aea30a476591150ceff9e6a55273ee4d79: Status 404 returned error can't find the container with id ac47bb92ddabf5175f7b672933fd23aea30a476591150ceff9e6a55273ee4d79 Jul 06 17:41:11.100069 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:11.099873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x6vm5" event={"ID":"e2494827-dc7f-402b-bf10-aae6a568d847","Type":"ContainerStarted","Data":"ac47bb92ddabf5175f7b672933fd23aea30a476591150ceff9e6a55273ee4d79"} Jul 06 17:41:11.102993 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:11.102958 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d0f98f4-e639-4f1d-9f96-6b2e38518ce0" containerID="0a1e745c463a8ad6e4d6dcfec09ed9938fa6b6b92882e623dfe6de00d0e88071" exitCode=0 Jul 06 17:41:11.103106 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:11.103018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" event={"ID":"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0","Type":"ContainerDied","Data":"0a1e745c463a8ad6e4d6dcfec09ed9938fa6b6b92882e623dfe6de00d0e88071"} Jul 06 17:41:11.872098 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:11.872061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:11.872268 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:11.872205 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:41:11.872317 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:11.872270 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls podName:6a0420eb-1489-4a4e-9dfd-a29b793f797e nodeName:}" failed. No retries permitted until 2026-07-06 17:41:15.872251723 +0000 UTC m=+43.582136257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls") pod "dns-default-rv48c" (UID: "6a0420eb-1489-4a4e-9dfd-a29b793f797e") : secret "dns-default-metrics-tls" not found Jul 06 17:41:11.923970 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:11.923921 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:12.109388 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:12.109355 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d0f98f4-e639-4f1d-9f96-6b2e38518ce0" containerID="0f5b2fb1d29eb5f5be9176a29faff9fcfc4d0c70550437eafe9a5398296769d1" exitCode=0 Jul 06 17:41:12.109860 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:12.109391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" event={"ID":"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0","Type":"ContainerDied","Data":"0f5b2fb1d29eb5f5be9176a29faff9fcfc4d0c70550437eafe9a5398296769d1"} Jul 06 17:41:12.324964 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:12.324918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:12.371140 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:12.371092 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:12.519463 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:12.519381 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:12.571111 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:12.571076 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:13.115190 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:13.115108 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" event={"ID":"9d0f98f4-e639-4f1d-9f96-6b2e38518ce0","Type":"ContainerStarted","Data":"8ecbf104a1f9a2a584ebbe118452a064b789592ab082bd0e4f519eab95069f79"} Jul 06 17:41:13.138194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:13.138157 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v8tkt" podStartSLOduration=8.879987845 podStartE2EDuration="41.138144081s" totalImagesPullingTime="32.258156236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:41:13.136301317 +0000 UTC m=+40.846185869" watchObservedRunningTime="2026-07-06 17:41:13.138144081 +0000 UTC m=+40.848028632" Jul 06 17:41:13.257898 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:13.257871 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:13.359078 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:13.359043 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:13.411579 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:13.411474 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:13.558565 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:13.558518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:13.614738 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:13.614696 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:14.118767 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:14.118729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x6vm5" event={"ID":"e2494827-dc7f-402b-bf10-aae6a568d847","Type":"ContainerStarted","Data":"1712d9636d1b426564acc484341d3e07e911cd495a9585c8c5cdd33a8d2fbc60"} Jul 06 17:41:14.135837 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:14.135800 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x6vm5" podStartSLOduration=3.177762276 podStartE2EDuration="6.135784151s" totalImagesPullingTime="2.958021875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:41:14.134169071 +0000 UTC m=+41.844053637" watchObservedRunningTime="2026-07-06 17:41:14.135784151 +0000 UTC m=+41.845668702" Jul 06 17:41:15.904537 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:15.904496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:15.904937 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:15.904665 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:41:15.904937 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:15.904730 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls podName:6a0420eb-1489-4a4e-9dfd-a29b793f797e nodeName:}" failed. No retries permitted until 2026-07-06 17:41:23.904711129 +0000 UTC m=+51.614595667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls") pod "dns-default-rv48c" (UID: "6a0420eb-1489-4a4e-9dfd-a29b793f797e") : secret "dns-default-metrics-tls" not found Jul 06 17:41:23.954378 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:23.954341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:23.954855 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:23.954497 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:41:23.954855 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:23.954593 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls podName:6a0420eb-1489-4a4e-9dfd-a29b793f797e nodeName:}" failed. No retries permitted until 2026-07-06 17:41:39.954575387 +0000 UTC m=+67.664459920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls") pod "dns-default-rv48c" (UID: "6a0420eb-1489-4a4e-9dfd-a29b793f797e") : secret "dns-default-metrics-tls" not found Jul 06 17:41:29.207729 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:29.207701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:29.307701 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:29.307675 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:33.084040 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:33.084008 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2q89" Jul 06 17:41:33.230115 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:33.230087 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:33.280928 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:33.280896 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:34.483808 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:34.483772 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:34.532956 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:34.532924 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:34.586228 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:34.586202 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:37.448939 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.448896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:41:37.451898 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.451877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 17:41:37.462383 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.462355 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc-original-pull-secret\") pod \"global-pull-secret-syncer-z7cwn\" (UID: \"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc\") " pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:41:37.549785 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.549740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:41:37.552716 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.552694 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 17:41:37.560664 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:37.560643 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 17:41:37.560750 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:37.560714 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:42:41.560696475 +0000 UTC m=+129.270581009 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : secret "metrics-daemon-secret" not found Jul 06 17:41:37.632662 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.632622 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7cwn" Jul 06 17:41:37.650678 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.650648 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:37.653616 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.653596 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 17:41:37.663500 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.663484 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 17:41:37.674157 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.674137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mskwz\" (UniqueName: \"kubernetes.io/projected/ae88b815-4a5a-4570-b590-4e4199d15ea5-kube-api-access-mskwz\") pod \"network-check-target-wxvxk\" (UID: \"ae88b815-4a5a-4570-b590-4e4199d15ea5\") " pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:37.748975 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.748938 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7cwn"] Jul 06 17:41:37.752050 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:41:37.752024 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3929d7f2_43e4_4cd4_97cc_f6fe9964c5dc.slice/crio-dfae41384222c88169f69f1ef12726be5fb933defac76a90d9d4df4f51d4850b WatchSource:0}: Error finding container dfae41384222c88169f69f1ef12726be5fb933defac76a90d9d4df4f51d4850b: Status 404 returned error can't find the container with id dfae41384222c88169f69f1ef12726be5fb933defac76a90d9d4df4f51d4850b Jul 06 17:41:37.928971 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.928948 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vsjgr\"" Jul 06 17:41:37.936371 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:37.936353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:38.052864 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:38.052828 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wxvxk"] Jul 06 17:41:38.055961 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:41:38.055937 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae88b815_4a5a_4570_b590_4e4199d15ea5.slice/crio-b06dad7f2b98cd1e61d15d2d8c847773a8d58a6a14839a570d51bd717622ada4 WatchSource:0}: Error finding container b06dad7f2b98cd1e61d15d2d8c847773a8d58a6a14839a570d51bd717622ada4: Status 404 returned error can't find the container with id b06dad7f2b98cd1e61d15d2d8c847773a8d58a6a14839a570d51bd717622ada4 Jul 06 17:41:38.173482 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:38.173439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wxvxk" event={"ID":"ae88b815-4a5a-4570-b590-4e4199d15ea5","Type":"ContainerStarted","Data":"b06dad7f2b98cd1e61d15d2d8c847773a8d58a6a14839a570d51bd717622ada4"} Jul 06 17:41:38.174777 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:38.174746 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7cwn" event={"ID":"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc","Type":"ContainerStarted","Data":"dfae41384222c88169f69f1ef12726be5fb933defac76a90d9d4df4f51d4850b"} Jul 06 17:41:39.968354 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:39.967834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:41:39.968354 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:39.967974 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:41:39.968354 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:41:39.968046 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls podName:6a0420eb-1489-4a4e-9dfd-a29b793f797e nodeName:}" failed. No retries permitted until 2026-07-06 17:42:11.968025016 +0000 UTC m=+99.677909558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls") pod "dns-default-rv48c" (UID: "6a0420eb-1489-4a4e-9dfd-a29b793f797e") : secret "dns-default-metrics-tls" not found Jul 06 17:41:43.192214 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:43.192177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wxvxk" event={"ID":"ae88b815-4a5a-4570-b590-4e4199d15ea5","Type":"ContainerStarted","Data":"ea8b3795c8c00df26f9cc98f788275bf28760c5fabff01ec10522a28d35799d0"} Jul 06 17:41:43.192688 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:43.192261 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:41:43.193560 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:43.193521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7cwn" event={"ID":"3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc","Type":"ContainerStarted","Data":"63e43940f448cb5cc6c0a49d5bc683139eb5a5ee586456f5e9b621b53ff07b1b"} Jul 06 17:41:43.207543 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:43.207501 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wxvxk" podStartSLOduration=66.548543758 podStartE2EDuration="1m11.207487846s" totalImagesPullingTime="4.658944088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:41:43.206966147 +0000 UTC m=+70.916850699" watchObservedRunningTime="2026-07-06 17:41:43.207487846 +0000 UTC m=+70.917372399" Jul 06 17:41:43.220406 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:43.220369 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z7cwn" podStartSLOduration=66.254179819 podStartE2EDuration="1m11.220356072s" totalImagesPullingTime="4.966176253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:41:43.219996674 +0000 UTC m=+70.929881220" watchObservedRunningTime="2026-07-06 17:41:43.220356072 +0000 UTC m=+70.930240615" Jul 06 17:41:43.898794 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:43.898763 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:43.948072 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:41:43.948043 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:00.679112 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:42:00.678998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:02.902517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:42:02.902480 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:11.969539 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:42:11.969502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:42:11.969962 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:42:11.969620 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:42:11.969962 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:42:11.969697 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls podName:6a0420eb-1489-4a4e-9dfd-a29b793f797e nodeName:}" failed. No retries permitted until 2026-07-06 17:43:15.969683061 +0000 UTC m=+163.679567591 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls") pod "dns-default-rv48c" (UID: "6a0420eb-1489-4a4e-9dfd-a29b793f797e") : secret "dns-default-metrics-tls" not found Jul 06 17:42:14.197592 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:42:14.197557 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wxvxk" Jul 06 17:42:41.562638 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:42:41.562593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:42:41.563117 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:42:41.562745 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 17:42:41.563117 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:42:41.562821 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:44:43.562803567 +0000 UTC m=+251.272688101 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : secret "metrics-daemon-secret" not found Jul 06 17:43:11.136562 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:43:11.136514 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rv48c" podUID="6a0420eb-1489-4a4e-9dfd-a29b793f797e" Jul 06 17:43:11.403304 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:43:11.403226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rv48c" Jul 06 17:43:11.819250 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:43:11.819209 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:43:15.991935 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:43:15.991887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:43:15.992389 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:43:15.992016 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:43:15.992389 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:43:15.992077 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls podName:6a0420eb-1489-4a4e-9dfd-a29b793f797e nodeName:}" failed. No retries permitted until 2026-07-06 17:45:17.992064139 +0000 UTC m=+285.701948674 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls") pod "dns-default-rv48c" (UID: "6a0420eb-1489-4a4e-9dfd-a29b793f797e") : secret "dns-default-metrics-tls" not found Jul 06 17:43:25.806000 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:43:25.805914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:44:00.657800 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:00.657749 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:29.359625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.359595 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7"] Jul 06 17:44:29.361249 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.361232 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.364141 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.364120 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 17:44:29.364141 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.364123 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 17:44:29.364406 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.364387 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 17:44:29.365684 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.365670 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:44:29.365743 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.365686 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dmqfj\"" Jul 06 17:44:29.373204 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.373182 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7"] Jul 06 17:44:29.458028 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.458000 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj"] Jul 06 17:44:29.459748 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.459727 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5"] Jul 06 17:44:29.459881 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.459844 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.461385 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.461367 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-947c94999-jgn7v"] Jul 06 17:44:29.461499 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.461469 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:29.462653 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.462627 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 17:44:29.462653 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.462635 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 17:44:29.462854 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.462840 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 17:44:29.462954 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.462936 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:44:29.463044 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.463029 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.463102 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.463065 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-crz9x\"" Jul 06 17:44:29.463778 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.463757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9282c18-5570-49ab-828f-5cdd0b6d576f-config\") pod \"service-ca-operator-5d46d9ffd4-wrrc7\" (UID: \"f9282c18-5570-49ab-828f-5cdd0b6d576f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.463866 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.463793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsdml\" (UniqueName: \"kubernetes.io/projected/f9282c18-5570-49ab-828f-5cdd0b6d576f-kube-api-access-dsdml\") pod \"service-ca-operator-5d46d9ffd4-wrrc7\" (UID: \"f9282c18-5570-49ab-828f-5cdd0b6d576f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.463866 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.463859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9282c18-5570-49ab-828f-5cdd0b6d576f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-wrrc7\" (UID: \"f9282c18-5570-49ab-828f-5cdd0b6d576f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.464378 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.464358 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 17:44:29.464449 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.464392 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-24whq\"" Jul 06 17:44:29.464637 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.464620 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 17:44:29.464693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.464654 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:44:29.466428 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.466410 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 17:44:29.466519 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.466449 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 17:44:29.466811 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.466755 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 17:44:29.466895 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.466807 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v256q\"" Jul 06 17:44:29.472749 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.472729 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 17:44:29.475537 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.475516 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj"] Jul 06 17:44:29.476245 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.476227 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5"] Jul 06 17:44:29.479405 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.479384 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-947c94999-jgn7v"] Jul 06 17:44:29.564873 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.564841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9282c18-5570-49ab-828f-5cdd0b6d576f-config\") pod \"service-ca-operator-5d46d9ffd4-wrrc7\" (UID: \"f9282c18-5570-49ab-828f-5cdd0b6d576f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.564873 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.564880 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.565118 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.564902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-registry-certificates\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.565118 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.564921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a23d1e9-e687-4bab-8ec5-a753fd1b7b48-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-lf2pj\" (UID: \"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.565118 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.564937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r67ct\" (UniqueName: \"kubernetes.io/projected/4fea23d5-e0b8-4069-9f81-0778ceef0495-kube-api-access-r67ct\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:29.565118 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.564974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2dwv\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-kube-api-access-g2dwv\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.565118 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsdml\" (UniqueName: \"kubernetes.io/projected/f9282c18-5570-49ab-828f-5cdd0b6d576f-kube-api-access-dsdml\") pod \"service-ca-operator-5d46d9ffd4-wrrc7\" (UID: \"f9282c18-5570-49ab-828f-5cdd0b6d576f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.565118 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z547j\" (UniqueName: \"kubernetes.io/projected/3a23d1e9-e687-4bab-8ec5-a753fd1b7b48-kube-api-access-z547j\") pod \"kube-storage-version-migrator-operator-846bf668f7-lf2pj\" (UID: \"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.565118 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9282c18-5570-49ab-828f-5cdd0b6d576f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-wrrc7\" (UID: \"f9282c18-5570-49ab-828f-5cdd0b6d576f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.565433 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-bound-sa-token\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.565433 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a23d1e9-e687-4bab-8ec5-a753fd1b7b48-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-lf2pj\" (UID: \"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.565433 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-image-registry-private-configuration\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.565433 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/759a64f8-de5d-485d-a519-89a5fa873021-ca-trust-extracted\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.565433 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-installation-pull-secrets\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.565433 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:29.565433 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565348 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-trusted-ca\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.565433 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.565365 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9282c18-5570-49ab-828f-5cdd0b6d576f-config\") pod \"service-ca-operator-5d46d9ffd4-wrrc7\" (UID: \"f9282c18-5570-49ab-828f-5cdd0b6d576f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.567202 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.567185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9282c18-5570-49ab-828f-5cdd0b6d576f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-wrrc7\" (UID: \"f9282c18-5570-49ab-828f-5cdd0b6d576f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.578351 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.578322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsdml\" (UniqueName: \"kubernetes.io/projected/f9282c18-5570-49ab-828f-5cdd0b6d576f-kube-api-access-dsdml\") pod \"service-ca-operator-5d46d9ffd4-wrrc7\" (UID: \"f9282c18-5570-49ab-828f-5cdd0b6d576f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.610850 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.610782 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:29.666224 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-installation-pull-secrets\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.666350 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:29.666350 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-trusted-ca\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.666416 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:29.666352 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 17:44:29.666416 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.666416 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-registry-certificates\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.666508 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:29.666436 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls podName:4fea23d5-e0b8-4069-9f81-0778ceef0495 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:30.166417526 +0000 UTC m=+237.876302060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lbkp5" (UID: "4fea23d5-e0b8-4069-9f81-0778ceef0495") : secret "samples-operator-tls" not found Jul 06 17:44:29.666508 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:29.666499 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:44:29.666639 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:29.666517 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947c94999-jgn7v: secret "image-registry-tls" not found Jul 06 17:44:29.666639 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a23d1e9-e687-4bab-8ec5-a753fd1b7b48-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-lf2pj\" (UID: \"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.666639 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:29.666588 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls podName:759a64f8-de5d-485d-a519-89a5fa873021 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:30.166570528 +0000 UTC m=+237.876455081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls") pod "image-registry-947c94999-jgn7v" (UID: "759a64f8-de5d-485d-a519-89a5fa873021") : secret "image-registry-tls" not found Jul 06 17:44:29.666639 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r67ct\" (UniqueName: \"kubernetes.io/projected/4fea23d5-e0b8-4069-9f81-0778ceef0495-kube-api-access-r67ct\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:29.666831 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2dwv\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-kube-api-access-g2dwv\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.666831 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z547j\" (UniqueName: \"kubernetes.io/projected/3a23d1e9-e687-4bab-8ec5-a753fd1b7b48-kube-api-access-z547j\") pod \"kube-storage-version-migrator-operator-846bf668f7-lf2pj\" (UID: \"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.666831 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-bound-sa-token\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.666831 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a23d1e9-e687-4bab-8ec5-a753fd1b7b48-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-lf2pj\" (UID: \"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.666831 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-image-registry-private-configuration\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.666831 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.666828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/759a64f8-de5d-485d-a519-89a5fa873021-ca-trust-extracted\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.667382 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.667356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/759a64f8-de5d-485d-a519-89a5fa873021-ca-trust-extracted\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.667498 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.667389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a23d1e9-e687-4bab-8ec5-a753fd1b7b48-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-lf2pj\" (UID: \"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.667498 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.667438 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-trusted-ca\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.667498 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.667472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-registry-certificates\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.668724 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.668701 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a23d1e9-e687-4bab-8ec5-a753fd1b7b48-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-lf2pj\" (UID: \"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.668892 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.668871 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-installation-pull-secrets\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.668945 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.668930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-image-registry-private-configuration\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.669768 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.669745 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" Jul 06 17:44:29.676984 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.676940 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r67ct\" (UniqueName: \"kubernetes.io/projected/4fea23d5-e0b8-4069-9f81-0778ceef0495-kube-api-access-r67ct\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:29.679012 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.678991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-bound-sa-token\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.679257 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.679240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2dwv\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-kube-api-access-g2dwv\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:29.679423 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.679407 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z547j\" (UniqueName: \"kubernetes.io/projected/3a23d1e9-e687-4bab-8ec5-a753fd1b7b48-kube-api-access-z547j\") pod \"kube-storage-version-migrator-operator-846bf668f7-lf2pj\" (UID: \"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.716137 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.715963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:29.770108 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.770081 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" Jul 06 17:44:29.790127 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.790099 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7"] Jul 06 17:44:29.793149 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:44:29.793122 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9282c18_5570_49ab_828f_5cdd0b6d576f.slice/crio-92f5637cbef46412a8a5f4227499b0732ccdc3df33b0969f9fc9f5b6ed6c8f0a WatchSource:0}: Error finding container 92f5637cbef46412a8a5f4227499b0732ccdc3df33b0969f9fc9f5b6ed6c8f0a: Status 404 returned error can't find the container with id 92f5637cbef46412a8a5f4227499b0732ccdc3df33b0969f9fc9f5b6ed6c8f0a Jul 06 17:44:29.889310 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:29.889240 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj"] Jul 06 17:44:29.892313 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:44:29.892287 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a23d1e9_e687_4bab_8ec5_a753fd1b7b48.slice/crio-f5badbce9185590061e6f59e4ad0803b9d5659ed5814f83268ea3b00bfadd21e WatchSource:0}: Error finding container f5badbce9185590061e6f59e4ad0803b9d5659ed5814f83268ea3b00bfadd21e: Status 404 returned error can't find the container with id f5badbce9185590061e6f59e4ad0803b9d5659ed5814f83268ea3b00bfadd21e Jul 06 17:44:30.171488 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:30.171397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:30.171488 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:30.171437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:30.171705 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:30.171542 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:44:30.171705 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:30.171573 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947c94999-jgn7v: secret "image-registry-tls" not found Jul 06 17:44:30.171705 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:30.171620 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls podName:759a64f8-de5d-485d-a519-89a5fa873021 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:31.171605751 +0000 UTC m=+238.881490285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls") pod "image-registry-947c94999-jgn7v" (UID: "759a64f8-de5d-485d-a519-89a5fa873021") : secret "image-registry-tls" not found Jul 06 17:44:30.171705 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:30.171543 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 17:44:30.171705 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:30.171694 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls podName:4fea23d5-e0b8-4069-9f81-0778ceef0495 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:31.171679201 +0000 UTC m=+238.881563751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lbkp5" (UID: "4fea23d5-e0b8-4069-9f81-0778ceef0495") : secret "samples-operator-tls" not found Jul 06 17:44:30.591461 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:30.591422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" event={"ID":"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48","Type":"ContainerStarted","Data":"f5badbce9185590061e6f59e4ad0803b9d5659ed5814f83268ea3b00bfadd21e"} Jul 06 17:44:30.592856 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:30.592822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" event={"ID":"f9282c18-5570-49ab-828f-5cdd0b6d576f","Type":"ContainerStarted","Data":"92f5637cbef46412a8a5f4227499b0732ccdc3df33b0969f9fc9f5b6ed6c8f0a"} Jul 06 17:44:31.178859 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:31.178828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:31.179056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:31.178942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:31.179056 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:31.179013 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:44:31.179056 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:31.179032 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 17:44:31.179056 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:31.179036 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947c94999-jgn7v: secret "image-registry-tls" not found Jul 06 17:44:31.179230 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:31.179097 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls podName:759a64f8-de5d-485d-a519-89a5fa873021 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:33.179076262 +0000 UTC m=+240.888960831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls") pod "image-registry-947c94999-jgn7v" (UID: "759a64f8-de5d-485d-a519-89a5fa873021") : secret "image-registry-tls" not found Jul 06 17:44:31.179230 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:31.179118 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls podName:4fea23d5-e0b8-4069-9f81-0778ceef0495 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:33.179106017 +0000 UTC m=+240.888990554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lbkp5" (UID: "4fea23d5-e0b8-4069-9f81-0778ceef0495") : secret "samples-operator-tls" not found Jul 06 17:44:31.991476 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:31.991444 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:32.600412 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:32.600372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" event={"ID":"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48","Type":"ContainerStarted","Data":"da21fe106dd73280fed7c1bbce0be1826d095a80b3ccd4019634612ac9f2059f"} Jul 06 17:44:32.616449 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:32.616397 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" podStartSLOduration=1.352683568 podStartE2EDuration="3.616380575s" totalImagesPullingTime="2.263697007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:32.61624674 +0000 UTC m=+240.326131292" watchObservedRunningTime="2026-07-06 17:44:32.616380575 +0000 UTC m=+240.326265105" Jul 06 17:44:33.035282 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.035246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:33.137109 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.137013 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:33.196310 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.196282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:33.196310 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.196315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:33.196497 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:33.196406 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:44:33.196497 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:33.196416 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947c94999-jgn7v: secret "image-registry-tls" not found Jul 06 17:44:33.196497 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:33.196438 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 17:44:33.196497 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:33.196461 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls podName:759a64f8-de5d-485d-a519-89a5fa873021 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:37.196448468 +0000 UTC m=+244.906332998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls") pod "image-registry-947c94999-jgn7v" (UID: "759a64f8-de5d-485d-a519-89a5fa873021") : secret "image-registry-tls" not found Jul 06 17:44:33.196497 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:33.196498 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls podName:4fea23d5-e0b8-4069-9f81-0778ceef0495 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:37.196480032 +0000 UTC m=+244.906364577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lbkp5" (UID: "4fea23d5-e0b8-4069-9f81-0778ceef0495") : secret "samples-operator-tls" not found Jul 06 17:44:33.535982 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.535952 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jddpc"] Jul 06 17:44:33.537932 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.537917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.541134 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.541110 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 17:44:33.541715 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.541698 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 17:44:33.541944 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.541931 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 17:44:33.542206 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.542188 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 17:44:33.542829 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.542814 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xts8l\"" Jul 06 17:44:33.555863 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.555845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jddpc"] Jul 06 17:44:33.599000 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.598963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/687c16e7-c239-44bb-ac04-8ae4c183f52a-crio-socket\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.599000 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.599000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wvjf\" (UniqueName: \"kubernetes.io/projected/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-api-access-9wvjf\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.599207 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.599063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.599207 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.599093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.599207 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.599186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/687c16e7-c239-44bb-ac04-8ae4c183f52a-data-volume\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.604319 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.604280 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" event={"ID":"f9282c18-5570-49ab-828f-5cdd0b6d576f","Type":"ContainerStarted","Data":"163751349e366b09d4dfc9e95ac6b67b4078d6d722dd5e8278d5ef959e8435e5"} Jul 06 17:44:33.616983 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.616958 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:33.660220 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.660159 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" podStartSLOduration=1.584306854 podStartE2EDuration="4.660143324s" totalImagesPullingTime="3.07583647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:33.659948356 +0000 UTC m=+241.369832908" watchObservedRunningTime="2026-07-06 17:44:33.660143324 +0000 UTC m=+241.370027907" Jul 06 17:44:33.676394 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.676357 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d"] Jul 06 17:44:33.678440 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.678422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d" Jul 06 17:44:33.681675 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.681622 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 17:44:33.681675 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.681636 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 17:44:33.681939 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.681916 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vscm9\"" Jul 06 17:44:33.690032 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.690003 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d"] Jul 06 17:44:33.699801 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.699779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjxq4\" (UniqueName: \"kubernetes.io/projected/a029e0e1-0bfe-4b61-bacb-c534d428b6a6-kube-api-access-rjxq4\") pod \"migrator-d57d58cc9-vw79d\" (UID: \"a029e0e1-0bfe-4b61-bacb-c534d428b6a6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d" Jul 06 17:44:33.699907 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.699883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.699960 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.699926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.700003 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.699974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/687c16e7-c239-44bb-ac04-8ae4c183f52a-data-volume\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.700173 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:33.700155 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:44:33.700348 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:33.700335 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:34.200316452 +0000 UTC m=+241.910200985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:44:33.700467 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.700335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/687c16e7-c239-44bb-ac04-8ae4c183f52a-data-volume\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.700529 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:33.700485 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:44:33.700529 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.700498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/687c16e7-c239-44bb-ac04-8ae4c183f52a-crio-socket\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.700669 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:33.700581 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:34.200543403 +0000 UTC m=+241.910427951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : configmap "kube-rbac-proxy" not found Jul 06 17:44:33.700768 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.700745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/687c16e7-c239-44bb-ac04-8ae4c183f52a-crio-socket\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.700856 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.700789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wvjf\" (UniqueName: \"kubernetes.io/projected/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-api-access-9wvjf\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.707008 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.706980 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:33.709262 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.709244 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wvjf\" (UniqueName: \"kubernetes.io/projected/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-api-access-9wvjf\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:33.766910 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.766873 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:33.802035 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.801962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjxq4\" (UniqueName: \"kubernetes.io/projected/a029e0e1-0bfe-4b61-bacb-c534d428b6a6-kube-api-access-rjxq4\") pod \"migrator-d57d58cc9-vw79d\" (UID: \"a029e0e1-0bfe-4b61-bacb-c534d428b6a6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d" Jul 06 17:44:33.810175 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.810141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjxq4\" (UniqueName: \"kubernetes.io/projected/a029e0e1-0bfe-4b61-bacb-c534d428b6a6-kube-api-access-rjxq4\") pod \"migrator-d57d58cc9-vw79d\" (UID: \"a029e0e1-0bfe-4b61-bacb-c534d428b6a6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d" Jul 06 17:44:33.987858 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:33.987801 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d" Jul 06 17:44:34.120307 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:34.120277 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d"] Jul 06 17:44:34.123032 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:44:34.123009 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda029e0e1_0bfe_4b61_bacb_c534d428b6a6.slice/crio-9cdc00e885e5cb60c8ef3a24783c98dea6530281c07ee671ee88eade8c679fe2 WatchSource:0}: Error finding container 9cdc00e885e5cb60c8ef3a24783c98dea6530281c07ee671ee88eade8c679fe2: Status 404 returned error can't find the container with id 9cdc00e885e5cb60c8ef3a24783c98dea6530281c07ee671ee88eade8c679fe2 Jul 06 17:44:34.204380 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:34.204343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:34.204380 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:34.204385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:34.204657 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:34.204464 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:44:34.204657 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:34.204531 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:35.204515978 +0000 UTC m=+242.914400512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : configmap "kube-rbac-proxy" not found Jul 06 17:44:34.204657 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:34.204577 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:44:34.204657 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:34.204631 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:35.204617594 +0000 UTC m=+242.914502129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:44:34.568758 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:34.568724 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:34.607798 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:34.607769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d" event={"ID":"a029e0e1-0bfe-4b61-bacb-c534d428b6a6","Type":"ContainerStarted","Data":"9cdc00e885e5cb60c8ef3a24783c98dea6530281c07ee671ee88eade8c679fe2"} Jul 06 17:44:35.216505 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:35.216471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:35.217087 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:35.216521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:35.217087 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:35.216730 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:44:35.217087 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:35.216798 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:37.216778983 +0000 UTC m=+244.926663514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:44:35.217272 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:35.217099 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:44:35.217272 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:35.217199 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:37.21717855 +0000 UTC m=+244.927063085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : configmap "kube-rbac-proxy" not found Jul 06 17:44:35.351499 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:35.351470 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rkqhf_e85ae0f7-be74-4213-a011-2ca424f86604/dns-node-resolver/0.log" Jul 06 17:44:35.726808 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:35.726767 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:36.552006 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.551978 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6kpx2_519470ee-d1c3-4103-9d2f-a0930c92c9d8/node-ca/0.log" Jul 06 17:44:36.615042 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.615010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d" event={"ID":"a029e0e1-0bfe-4b61-bacb-c534d428b6a6","Type":"ContainerStarted","Data":"3e8d95f086278707e02dfbbeb46f2a062018025cdbd1675a26c3d9fdee522076"} Jul 06 17:44:36.615212 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.615064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d" event={"ID":"a029e0e1-0bfe-4b61-bacb-c534d428b6a6","Type":"ContainerStarted","Data":"a37d4ea44f2c5aaafcc148a8bae09b331afe3a575ffd8dc079c4001fdc839077"} Jul 06 17:44:36.630779 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.630741 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vw79d" podStartSLOduration=1.8899413699999998 podStartE2EDuration="3.630726232s" totalImagesPullingTime="1.740784862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:36.630030985 +0000 UTC m=+244.339915537" watchObservedRunningTime="2026-07-06 17:44:36.630726232 +0000 UTC m=+244.340610785" Jul 06 17:44:36.704568 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.704511 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:36.755142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.755094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:36.874800 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.874724 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vqs7j"] Jul 06 17:44:36.877658 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.877643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:36.880897 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.880869 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 17:44:36.880897 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.880885 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 17:44:36.881099 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.880884 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 17:44:36.881099 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.880870 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 17:44:36.881099 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.880959 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nnztg\"" Jul 06 17:44:36.886830 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.886811 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vqs7j"] Jul 06 17:44:36.908145 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.908115 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:36.931173 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.931150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b706fa23-35d1-4629-993e-0378e495cec4-signing-key\") pod \"service-ca-758f599c5-vqs7j\" (UID: \"b706fa23-35d1-4629-993e-0378e495cec4\") " pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:36.931275 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.931206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b706fa23-35d1-4629-993e-0378e495cec4-signing-cabundle\") pod \"service-ca-758f599c5-vqs7j\" (UID: \"b706fa23-35d1-4629-993e-0378e495cec4\") " pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:36.931275 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:36.931227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jmr\" (UniqueName: \"kubernetes.io/projected/b706fa23-35d1-4629-993e-0378e495cec4-kube-api-access-76jmr\") pod \"service-ca-758f599c5-vqs7j\" (UID: \"b706fa23-35d1-4629-993e-0378e495cec4\") " pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:37.022430 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.022398 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:37.032488 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.032460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b706fa23-35d1-4629-993e-0378e495cec4-signing-key\") pod \"service-ca-758f599c5-vqs7j\" (UID: \"b706fa23-35d1-4629-993e-0378e495cec4\") " pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:37.032623 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.032517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b706fa23-35d1-4629-993e-0378e495cec4-signing-cabundle\") pod \"service-ca-758f599c5-vqs7j\" (UID: \"b706fa23-35d1-4629-993e-0378e495cec4\") " pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:37.032623 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.032542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jmr\" (UniqueName: \"kubernetes.io/projected/b706fa23-35d1-4629-993e-0378e495cec4-kube-api-access-76jmr\") pod \"service-ca-758f599c5-vqs7j\" (UID: \"b706fa23-35d1-4629-993e-0378e495cec4\") " pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:37.033237 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.033218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b706fa23-35d1-4629-993e-0378e495cec4-signing-cabundle\") pod \"service-ca-758f599c5-vqs7j\" (UID: \"b706fa23-35d1-4629-993e-0378e495cec4\") " pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:37.034820 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.034804 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b706fa23-35d1-4629-993e-0378e495cec4-signing-key\") pod \"service-ca-758f599c5-vqs7j\" (UID: \"b706fa23-35d1-4629-993e-0378e495cec4\") " pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:37.040795 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.040772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jmr\" (UniqueName: \"kubernetes.io/projected/b706fa23-35d1-4629-993e-0378e495cec4-kube-api-access-76jmr\") pod \"service-ca-758f599c5-vqs7j\" (UID: \"b706fa23-35d1-4629-993e-0378e495cec4\") " pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:37.186199 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.186164 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vqs7j" Jul 06 17:44:37.235003 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.234930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:37.235003 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.234987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:37.235197 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.235056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:37.235197 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:37.235060 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:44:37.235197 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.235086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:37.235197 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:37.235149 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:41.235127699 +0000 UTC m=+248.945012249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : configmap "kube-rbac-proxy" not found Jul 06 17:44:37.235403 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:37.235206 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:44:37.235403 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:37.235219 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-947c94999-jgn7v: secret "image-registry-tls" not found Jul 06 17:44:37.235403 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:37.235267 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls podName:759a64f8-de5d-485d-a519-89a5fa873021 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:45.235250014 +0000 UTC m=+252.945134563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls") pod "image-registry-947c94999-jgn7v" (UID: "759a64f8-de5d-485d-a519-89a5fa873021") : secret "image-registry-tls" not found Jul 06 17:44:37.235403 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:37.235339 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:44:37.235403 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:37.235371 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:41.235360765 +0000 UTC m=+248.945245312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:44:37.235685 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:37.235422 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 17:44:37.235685 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:37.235451 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls podName:4fea23d5-e0b8-4069-9f81-0778ceef0495 nodeName:}" failed. No retries permitted until 2026-07-06 17:44:45.235442261 +0000 UTC m=+252.945326818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lbkp5" (UID: "4fea23d5-e0b8-4069-9f81-0778ceef0495") : secret "samples-operator-tls" not found Jul 06 17:44:37.308492 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.308457 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vqs7j"] Jul 06 17:44:37.311181 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:44:37.311148 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb706fa23_35d1_4629_993e_0378e495cec4.slice/crio-eddc751d06691bbe84b369ad3d80850be844588e3ce41df5e6cdc58b0150f8ff WatchSource:0}: Error finding container eddc751d06691bbe84b369ad3d80850be844588e3ce41df5e6cdc58b0150f8ff: Status 404 returned error can't find the container with id eddc751d06691bbe84b369ad3d80850be844588e3ce41df5e6cdc58b0150f8ff Jul 06 17:44:37.352965 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.352943 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x6vm5_e2494827-dc7f-402b-bf10-aae6a568d847/serve-healthcheck-canary/0.log" Jul 06 17:44:37.619827 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.619727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vqs7j" event={"ID":"b706fa23-35d1-4629-993e-0378e495cec4","Type":"ContainerStarted","Data":"c65f8af79165ed6cca8ba95b9eac843181523b4923927ea8fb41e23529b1f25b"} Jul 06 17:44:37.619827 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.619787 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vqs7j" event={"ID":"b706fa23-35d1-4629-993e-0378e495cec4","Type":"ContainerStarted","Data":"eddc751d06691bbe84b369ad3d80850be844588e3ce41df5e6cdc58b0150f8ff"} Jul 06 17:44:37.641002 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.640948 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-vqs7j" podStartSLOduration=1.640932721 podStartE2EDuration="1.640932721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:37.640322057 +0000 UTC m=+245.350206610" watchObservedRunningTime="2026-07-06 17:44:37.640932721 +0000 UTC m=+245.350817273" Jul 06 17:44:37.730747 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:37.730712 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:39.131984 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:39.131949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:39.297159 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:39.297131 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:39.431966 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:39.431868 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:39.532817 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:39.532787 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:39.633573 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:39.633526 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:39.868563 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:39.868504 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:39.969950 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:39.969914 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:40.221940 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:40.221905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:40.321891 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:40.321859 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:41.217142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:41.217110 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:41.273408 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:41.273362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:41.273408 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:41.273413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:41.273847 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:41.273491 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:44:41.273847 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:41.273507 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:44:41.273847 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:41.273580 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:49.273561131 +0000 UTC m=+256.983445677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : configmap "kube-rbac-proxy" not found Jul 06 17:44:41.273847 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:41.273597 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:44:49.273591231 +0000 UTC m=+256.983475761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:44:41.419121 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:41.419087 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:41.619359 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:41.619269 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:42.022830 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:42.022794 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:42.619737 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:42.619704 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:43.013270 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:43.013239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:43.114699 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:43.114656 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:43.221750 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:43.221713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:43.500831 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:43.500801 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:43.594002 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:43.593977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:44:43.594139 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:43.594078 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 17:44:43.594186 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:43.594151 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs podName:6f08132d-2a61-4afc-b235-98fe6694c5cb nodeName:}" failed. No retries permitted until 2026-07-06 17:46:45.594136577 +0000 UTC m=+373.304021113 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs") pod "network-metrics-daemon-7jgm5" (UID: "6f08132d-2a61-4afc-b235-98fe6694c5cb") : secret "metrics-daemon-secret" not found Jul 06 17:44:43.821249 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:43.821164 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:44.420161 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:44.420125 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:44.624469 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:44.624437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:45.020879 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.020842 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:45.274335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.274247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:45.310458 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.310431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:45.310606 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.310463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:45.312789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.312756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") pod \"image-registry-947c94999-jgn7v\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:45.312914 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.312897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fea23d5-e0b8-4069-9f81-0778ceef0495-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lbkp5\" (UID: \"4fea23d5-e0b8-4069-9f81-0778ceef0495\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:45.324057 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.324033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:45.379011 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.378991 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-24whq\"" Jul 06 17:44:45.384873 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.384850 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v256q\"" Jul 06 17:44:45.386869 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.386853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" Jul 06 17:44:45.393421 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.393407 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:45.520264 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.520237 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5"] Jul 06 17:44:45.538268 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.538247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-947c94999-jgn7v"] Jul 06 17:44:45.539705 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:44:45.539676 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759a64f8_de5d_485d_a519_89a5fa873021.slice/crio-1b39388701887a369a178b2b807aa90b95ac6d4cd62e3a6b3956c66a9b822b8d WatchSource:0}: Error finding container 1b39388701887a369a178b2b807aa90b95ac6d4cd62e3a6b3956c66a9b822b8d: Status 404 returned error can't find the container with id 1b39388701887a369a178b2b807aa90b95ac6d4cd62e3a6b3956c66a9b822b8d Jul 06 17:44:45.619475 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.619407 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:45.653718 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.653685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-947c94999-jgn7v" event={"ID":"759a64f8-de5d-485d-a519-89a5fa873021","Type":"ContainerStarted","Data":"315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337"} Jul 06 17:44:45.653855 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.653747 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-947c94999-jgn7v" event={"ID":"759a64f8-de5d-485d-a519-89a5fa873021","Type":"ContainerStarted","Data":"1b39388701887a369a178b2b807aa90b95ac6d4cd62e3a6b3956c66a9b822b8d"} Jul 06 17:44:45.653855 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.653773 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:44:45.654853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.654832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" event={"ID":"4fea23d5-e0b8-4069-9f81-0778ceef0495","Type":"ContainerStarted","Data":"2a776947dfb5e9d1e65c6d36ebe6f64ea1438601d41ac529ccd8ee324de0d2c7"} Jul 06 17:44:45.673995 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:45.673945 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-947c94999-jgn7v" podStartSLOduration=16.673931038 podStartE2EDuration="16.673931038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:45.672291083 +0000 UTC m=+253.382175636" watchObservedRunningTime="2026-07-06 17:44:45.673931038 +0000 UTC m=+253.383815586" Jul 06 17:44:46.217633 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:46.217595 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:46.626012 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:46.625915 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:46.791929 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:46.791892 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:47.015996 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:47.015950 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:47.419046 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:47.418976 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:47.619898 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:47.619850 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:48.222248 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:48.222218 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:48.617671 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:48.617634 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:48.667270 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:48.667237 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" event={"ID":"4fea23d5-e0b8-4069-9f81-0778ceef0495","Type":"ContainerStarted","Data":"448619eaf18ee9b344dc5546861c310bf7de515626cc9af6af09754279d247bb"} Jul 06 17:44:48.667418 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:48.667289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" event={"ID":"4fea23d5-e0b8-4069-9f81-0778ceef0495","Type":"ContainerStarted","Data":"6a47d00331d26ed7ed2a04653a192d7f2b48dfd80e2919fbf8adb40f27029d1a"} Jul 06 17:44:48.683705 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:48.683667 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lbkp5" podStartSLOduration=17.11756509 podStartE2EDuration="19.683652453s" totalImagesPullingTime="2.566087363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:48.682148394 +0000 UTC m=+256.392032945" watchObservedRunningTime="2026-07-06 17:44:48.683652453 +0000 UTC m=+256.393537005" Jul 06 17:44:48.816864 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:48.816811 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:49.221348 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:49.221315 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:49.345200 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:49.345161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:49.345345 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:49.345207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:49.345385 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:49.345354 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:44:49.345418 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:44:49.345410 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls podName:687c16e7-c239-44bb-ac04-8ae4c183f52a nodeName:}" failed. No retries permitted until 2026-07-06 17:45:05.345394452 +0000 UTC m=+273.055279002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jddpc" (UID: "687c16e7-c239-44bb-ac04-8ae4c183f52a") : secret "insights-runtime-extractor-tls" not found Jul 06 17:44:49.345718 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:49.345699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/687c16e7-c239-44bb-ac04-8ae4c183f52a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:44:49.620941 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:49.620844 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:49.818105 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:49.818073 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:54.663365 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:54.663279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:54.756946 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:54.756912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:54.810342 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:54.810315 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:55.002081 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:55.002053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:55.163737 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:55.163706 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-947c94999-jgn7v"] Jul 06 17:44:55.282098 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:55.282029 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:55.382194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:55.382165 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:55.481987 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:55.481951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:55.581339 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:55.581247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:56.182571 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:56.182512 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:56.389292 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:56.389241 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:56.448162 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:56.448126 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:56.792849 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:44:56.792757 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:02.410455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:02.410420 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:02.471112 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:02.471078 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:04.406474 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:04.406434 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:04.564608 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:04.564573 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4"] Jul 06 17:45:04.565361 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:04.565326 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:04.567213 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:04.567197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" Jul 06 17:45:04.569936 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:04.569914 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2pg6m\"" Jul 06 17:45:04.570022 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:04.569958 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 17:45:04.574506 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:04.574485 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4"] Jul 06 17:45:04.655777 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:04.655739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2cfe1659-e7a2-4254-89f9-fec80864cf39-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-66wf4\" (UID: \"2cfe1659-e7a2-4254-89f9-fec80864cf39\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" Jul 06 17:45:04.756366 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:04.756330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2cfe1659-e7a2-4254-89f9-fec80864cf39-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-66wf4\" (UID: \"2cfe1659-e7a2-4254-89f9-fec80864cf39\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" Jul 06 17:45:04.756588 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:04.756474 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 17:45:04.756588 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:04.756537 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cfe1659-e7a2-4254-89f9-fec80864cf39-tls-certificates podName:2cfe1659-e7a2-4254-89f9-fec80864cf39 nodeName:}" failed. No retries permitted until 2026-07-06 17:45:05.256521913 +0000 UTC m=+272.966406448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2cfe1659-e7a2-4254-89f9-fec80864cf39-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-66wf4" (UID: "2cfe1659-e7a2-4254-89f9-fec80864cf39") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 17:45:05.030987 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.030895 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:05.169454 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.169418 2577 patch_prober.go:28] interesting pod/image-registry-947c94999-jgn7v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 17:45:05.169629 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.169471 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-947c94999-jgn7v" podUID="759a64f8-de5d-485d-a519-89a5fa873021" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 17:45:05.260410 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.260371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2cfe1659-e7a2-4254-89f9-fec80864cf39-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-66wf4\" (UID: \"2cfe1659-e7a2-4254-89f9-fec80864cf39\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" Jul 06 17:45:05.262774 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.262756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2cfe1659-e7a2-4254-89f9-fec80864cf39-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-66wf4\" (UID: \"2cfe1659-e7a2-4254-89f9-fec80864cf39\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" Jul 06 17:45:05.361195 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.361101 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:45:05.363439 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.363410 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/687c16e7-c239-44bb-ac04-8ae4c183f52a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jddpc\" (UID: \"687c16e7-c239-44bb-ac04-8ae4c183f52a\") " pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:45:05.476958 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.476924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" Jul 06 17:45:05.596644 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.596617 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4"] Jul 06 17:45:05.599805 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:05.599776 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfe1659_e7a2_4254_89f9_fec80864cf39.slice/crio-21e830c588c647f0d1f6d83abfcba1c12164f9fb066014f44908cc2be812eed0 WatchSource:0}: Error finding container 21e830c588c647f0d1f6d83abfcba1c12164f9fb066014f44908cc2be812eed0: Status 404 returned error can't find the container with id 21e830c588c647f0d1f6d83abfcba1c12164f9fb066014f44908cc2be812eed0 Jul 06 17:45:05.647084 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.646997 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jddpc" Jul 06 17:45:05.721498 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.721469 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" event={"ID":"2cfe1659-e7a2-4254-89f9-fec80864cf39","Type":"ContainerStarted","Data":"21e830c588c647f0d1f6d83abfcba1c12164f9fb066014f44908cc2be812eed0"} Jul 06 17:45:05.791858 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:05.791824 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jddpc"] Jul 06 17:45:05.794616 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:05.794591 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687c16e7_c239_44bb_ac04_8ae4c183f52a.slice/crio-f78d86bb3810718a75a5f0f4c721d4b87a54e4b1ccf4bbd6f85cf5fe803da205 WatchSource:0}: Error finding container f78d86bb3810718a75a5f0f4c721d4b87a54e4b1ccf4bbd6f85cf5fe803da205: Status 404 returned error can't find the container with id f78d86bb3810718a75a5f0f4c721d4b87a54e4b1ccf4bbd6f85cf5fe803da205 Jul 06 17:45:06.728917 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.728823 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jddpc" event={"ID":"687c16e7-c239-44bb-ac04-8ae4c183f52a","Type":"ContainerStarted","Data":"f78d86bb3810718a75a5f0f4c721d4b87a54e4b1ccf4bbd6f85cf5fe803da205"} Jul 06 17:45:06.812323 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.812227 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:06.812602 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.812581 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cbf5bd8d5-wp6l7"] Jul 06 17:45:06.816016 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.815952 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:06.822448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.821967 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 17:45:06.822448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.822076 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 17:45:06.822448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.822131 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cbf5bd8d5-wp6l7"] Jul 06 17:45:06.822448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.822187 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 17:45:06.822448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.822261 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 17:45:06.822448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.822299 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 17:45:06.822902 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.822510 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 17:45:06.822902 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.822721 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kbbzg\"" Jul 06 17:45:06.825561 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.825526 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 17:45:06.829031 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.828680 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 17:45:06.867026 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.866952 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:06.972780 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.972736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-oauth-config\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:06.972966 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.972786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-serving-cert\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:06.972966 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.972826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-service-ca\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:06.972966 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.972872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-trusted-ca-bundle\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:06.972966 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.972905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-oauth-serving-cert\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:06.972966 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.972946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-console-config\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:06.973271 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:06.972971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sn29\" (UniqueName: \"kubernetes.io/projected/74b57821-2421-489f-922b-d2095104f1a7-kube-api-access-6sn29\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.074281 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.074047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-oauth-config\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.074281 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.074083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-serving-cert\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.074281 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.074115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-service-ca\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.074582 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.074426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-trusted-ca-bundle\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.074582 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.074473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-oauth-serving-cert\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.074582 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.074516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-console-config\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.074763 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.074579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sn29\" (UniqueName: \"kubernetes.io/projected/74b57821-2421-489f-922b-d2095104f1a7-kube-api-access-6sn29\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.075032 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.074938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-service-ca\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.075256 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.075150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-console-config\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.075499 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.075481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-oauth-serving-cert\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.075951 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.075930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-trusted-ca-bundle\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.077373 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.077352 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-oauth-config\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.077712 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.077689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-serving-cert\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.083494 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.083470 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sn29\" (UniqueName: \"kubernetes.io/projected/74b57821-2421-489f-922b-d2095104f1a7-kube-api-access-6sn29\") pod \"console-6cbf5bd8d5-wp6l7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.133456 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.133426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:07.285729 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.285704 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cbf5bd8d5-wp6l7"] Jul 06 17:45:07.289686 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:07.289655 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b57821_2421_489f_922b_d2095104f1a7.slice/crio-3905c49ff1367a5d840d4f720de35bbf1be76db26a3e4c0bbc1ae43e3ed1fc19 WatchSource:0}: Error finding container 3905c49ff1367a5d840d4f720de35bbf1be76db26a3e4c0bbc1ae43e3ed1fc19: Status 404 returned error can't find the container with id 3905c49ff1367a5d840d4f720de35bbf1be76db26a3e4c0bbc1ae43e3ed1fc19 Jul 06 17:45:07.734856 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.734818 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" event={"ID":"2cfe1659-e7a2-4254-89f9-fec80864cf39","Type":"ContainerStarted","Data":"34139e93de3ab4cf6da3b02d06127643da605a7a97784cf1b493b950a8ac89c9"} Jul 06 17:45:07.735319 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.734965 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" Jul 06 17:45:07.736444 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.736412 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbf5bd8d5-wp6l7" event={"ID":"74b57821-2421-489f-922b-d2095104f1a7","Type":"ContainerStarted","Data":"3905c49ff1367a5d840d4f720de35bbf1be76db26a3e4c0bbc1ae43e3ed1fc19"} Jul 06 17:45:07.741248 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.741225 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" Jul 06 17:45:07.758693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:07.758637 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-66wf4" podStartSLOduration=2.16736036 podStartE2EDuration="3.758618495s" totalImagesPullingTime="1.591258135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:07.758061971 +0000 UTC m=+275.467946523" watchObservedRunningTime="2026-07-06 17:45:07.758618495 +0000 UTC m=+275.468503048" Jul 06 17:45:08.592176 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:08.592140 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:08.657251 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:08.657200 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:08.922698 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:08.922593 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:09.129677 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:09.129636 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:10.747451 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:10.747420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jddpc" event={"ID":"687c16e7-c239-44bb-ac04-8ae4c183f52a","Type":"ContainerStarted","Data":"1c7a02b6cc7373ebe19204c183989c217a54bae59d9056e3e5325e90cfcf52de"} Jul 06 17:45:11.752774 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:11.752738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jddpc" event={"ID":"687c16e7-c239-44bb-ac04-8ae4c183f52a","Type":"ContainerStarted","Data":"afab313a38680e5101687102b29c5c66767427c421b6f51be89a04965c728c0d"} Jul 06 17:45:11.754064 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:11.754040 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbf5bd8d5-wp6l7" event={"ID":"74b57821-2421-489f-922b-d2095104f1a7","Type":"ContainerStarted","Data":"b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e"} Jul 06 17:45:11.770996 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:11.770911 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cbf5bd8d5-wp6l7" podStartSLOduration=1.549716553 podStartE2EDuration="5.770898241s" totalImagesPullingTime="4.221181688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:11.77044349 +0000 UTC m=+279.480328042" watchObservedRunningTime="2026-07-06 17:45:11.770898241 +0000 UTC m=+279.480782856" Jul 06 17:45:12.606072 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:12.606034 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:14.404684 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:14.404641 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rv48c" podUID="6a0420eb-1489-4a4e-9dfd-a29b793f797e" Jul 06 17:45:14.766823 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:14.766795 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rv48c" Jul 06 17:45:14.766985 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:14.766819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jddpc" event={"ID":"687c16e7-c239-44bb-ac04-8ae4c183f52a","Type":"ContainerStarted","Data":"19ba82ee00562b05a72417b0284d70fadbf1a5cbc5029346cbd48f0c67a67100"} Jul 06 17:45:14.784610 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:14.784571 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jddpc" podStartSLOduration=33.795790286 podStartE2EDuration="41.784539866s" totalImagesPullingTime="7.98874958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:44:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:14.783444271 +0000 UTC m=+282.493328824" watchObservedRunningTime="2026-07-06 17:45:14.784539866 +0000 UTC m=+282.494424435" Jul 06 17:45:15.169219 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:15.169129 2577 patch_prober.go:28] interesting pod/image-registry-947c94999-jgn7v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 17:45:15.169219 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:15.169183 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-947c94999-jgn7v" podUID="759a64f8-de5d-485d-a519-89a5fa873021" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 17:45:16.013366 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:16.013325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:16.066881 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:16.066843 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:16.212883 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:16.212845 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:16.312882 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:16.312790 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:17.134145 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:17.134112 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:17.134145 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:17.134166 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:17.135633 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:17.135611 2577 patch_prober.go:28] interesting pod/console-6cbf5bd8d5-wp6l7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jul 06 17:45:17.135696 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:17.135654 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cbf5bd8d5-wp6l7" podUID="74b57821-2421-489f-922b-d2095104f1a7" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jul 06 17:45:18.058990 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:18.058954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:45:18.061245 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:18.061225 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a0420eb-1489-4a4e-9dfd-a29b793f797e-metrics-tls\") pod \"dns-default-rv48c\" (UID: \"6a0420eb-1489-4a4e-9dfd-a29b793f797e\") " pod="openshift-dns/dns-default-rv48c" Jul 06 17:45:18.070049 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:18.070018 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lmt7g\"" Jul 06 17:45:18.077406 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:18.077384 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rv48c" Jul 06 17:45:18.198120 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:18.198101 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rv48c"] Jul 06 17:45:18.200163 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:18.200135 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0420eb_1489_4a4e_9dfd_a29b793f797e.slice/crio-aa669894ed77a9709845a307c56247b8e3fcefd3fa298a737a24591bee073d32 WatchSource:0}: Error finding container aa669894ed77a9709845a307c56247b8e3fcefd3fa298a737a24591bee073d32: Status 404 returned error can't find the container with id aa669894ed77a9709845a307c56247b8e3fcefd3fa298a737a24591bee073d32 Jul 06 17:45:18.780399 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:18.780366 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rv48c" event={"ID":"6a0420eb-1489-4a4e-9dfd-a29b793f797e","Type":"ContainerStarted","Data":"aa669894ed77a9709845a307c56247b8e3fcefd3fa298a737a24591bee073d32"} Jul 06 17:45:20.183190 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.183077 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-947c94999-jgn7v" podUID="759a64f8-de5d-485d-a519-89a5fa873021" containerName="registry" containerID="cri-o://315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337" gracePeriod=30 Jul 06 17:45:20.265798 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.265767 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:20.410632 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.410612 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:45:20.476950 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.476924 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2dwv\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-kube-api-access-g2dwv\") pod \"759a64f8-de5d-485d-a519-89a5fa873021\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " Jul 06 17:45:20.477127 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.476989 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-trusted-ca\") pod \"759a64f8-de5d-485d-a519-89a5fa873021\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " Jul 06 17:45:20.477127 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.477017 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-image-registry-private-configuration\") pod \"759a64f8-de5d-485d-a519-89a5fa873021\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " Jul 06 17:45:20.477127 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.477057 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-bound-sa-token\") pod \"759a64f8-de5d-485d-a519-89a5fa873021\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " Jul 06 17:45:20.477127 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.477091 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/759a64f8-de5d-485d-a519-89a5fa873021-ca-trust-extracted\") pod \"759a64f8-de5d-485d-a519-89a5fa873021\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " Jul 06 17:45:20.477127 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.477119 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-installation-pull-secrets\") pod \"759a64f8-de5d-485d-a519-89a5fa873021\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " Jul 06 17:45:20.477381 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.477146 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") pod \"759a64f8-de5d-485d-a519-89a5fa873021\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " Jul 06 17:45:20.477381 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.477188 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-registry-certificates\") pod \"759a64f8-de5d-485d-a519-89a5fa873021\" (UID: \"759a64f8-de5d-485d-a519-89a5fa873021\") " Jul 06 17:45:20.477479 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.477441 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "759a64f8-de5d-485d-a519-89a5fa873021" (UID: "759a64f8-de5d-485d-a519-89a5fa873021"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:45:20.477828 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.477805 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "759a64f8-de5d-485d-a519-89a5fa873021" (UID: "759a64f8-de5d-485d-a519-89a5fa873021"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:45:20.479458 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.479434 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "759a64f8-de5d-485d-a519-89a5fa873021" (UID: "759a64f8-de5d-485d-a519-89a5fa873021"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:45:20.479607 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.479437 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-kube-api-access-g2dwv" (OuterVolumeSpecName: "kube-api-access-g2dwv") pod "759a64f8-de5d-485d-a519-89a5fa873021" (UID: "759a64f8-de5d-485d-a519-89a5fa873021"). InnerVolumeSpecName "kube-api-access-g2dwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:45:20.479679 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.479604 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "759a64f8-de5d-485d-a519-89a5fa873021" (UID: "759a64f8-de5d-485d-a519-89a5fa873021"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:45:20.479679 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.479628 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "759a64f8-de5d-485d-a519-89a5fa873021" (UID: "759a64f8-de5d-485d-a519-89a5fa873021"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:45:20.479776 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.479739 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "759a64f8-de5d-485d-a519-89a5fa873021" (UID: "759a64f8-de5d-485d-a519-89a5fa873021"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:45:20.485476 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.485452 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759a64f8-de5d-485d-a519-89a5fa873021-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "759a64f8-de5d-485d-a519-89a5fa873021" (UID: "759a64f8-de5d-485d-a519-89a5fa873021"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:45:20.581834 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.578734 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-trusted-ca\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:45:20.581834 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.578768 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-image-registry-private-configuration\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:45:20.581834 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.578784 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-bound-sa-token\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:45:20.581834 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.578799 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/759a64f8-de5d-485d-a519-89a5fa873021-ca-trust-extracted\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:45:20.581834 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.578820 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/759a64f8-de5d-485d-a519-89a5fa873021-installation-pull-secrets\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:45:20.581834 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.578834 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-registry-tls\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:45:20.581834 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.578848 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/759a64f8-de5d-485d-a519-89a5fa873021-registry-certificates\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:45:20.581834 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.578861 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2dwv\" (UniqueName: \"kubernetes.io/projected/759a64f8-de5d-485d-a519-89a5fa873021-kube-api-access-g2dwv\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:45:20.788373 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.788296 2577 generic.go:356] "Generic (PLEG): container finished" podID="759a64f8-de5d-485d-a519-89a5fa873021" containerID="315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337" exitCode=0 Jul 06 17:45:20.788373 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.788349 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-947c94999-jgn7v" Jul 06 17:45:20.788526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.788371 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-947c94999-jgn7v" event={"ID":"759a64f8-de5d-485d-a519-89a5fa873021","Type":"ContainerDied","Data":"315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337"} Jul 06 17:45:20.788526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.788454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-947c94999-jgn7v" event={"ID":"759a64f8-de5d-485d-a519-89a5fa873021","Type":"ContainerDied","Data":"1b39388701887a369a178b2b807aa90b95ac6d4cd62e3a6b3956c66a9b822b8d"} Jul 06 17:45:20.789489 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.788472 2577 scope.go:117] "RemoveContainer" containerID="315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337" Jul 06 17:45:20.790351 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.790278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rv48c" event={"ID":"6a0420eb-1489-4a4e-9dfd-a29b793f797e","Type":"ContainerStarted","Data":"927e3c4b9549cd6d4510e9169fd299129492a465b26cbf28abd2f0bc3231e308"} Jul 06 17:45:20.790351 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.790326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rv48c" event={"ID":"6a0420eb-1489-4a4e-9dfd-a29b793f797e","Type":"ContainerStarted","Data":"76615b8f4db362c6536927f266c86e73f0789694304850a4f88215a5006d2282"} Jul 06 17:45:20.790582 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.790371 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rv48c" Jul 06 17:45:20.797967 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.797953 2577 scope.go:117] "RemoveContainer" containerID="315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337" Jul 06 17:45:20.798238 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:20.798216 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337\": container with ID starting with 315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337 not found: ID does not exist" containerID="315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337" Jul 06 17:45:20.798280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.798245 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337"} err="failed to get container status \"315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337\": rpc error: code = NotFound desc = could not find container \"315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337\": container with ID starting with 315486fc483e560446048026aa0969871f15c5bb4d483a9a5d790d1ee9267337 not found: ID does not exist" Jul 06 17:45:20.811301 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.811258 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rv48c" podStartSLOduration=251.189189381 podStartE2EDuration="4m12.811242238s" totalImagesPullingTime="1.622052857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:20.811094903 +0000 UTC m=+288.520979469" watchObservedRunningTime="2026-07-06 17:45:20.811242238 +0000 UTC m=+288.521126785" Jul 06 17:45:20.824101 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.824083 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-947c94999-jgn7v"] Jul 06 17:45:20.828504 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:20.828485 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-947c94999-jgn7v"] Jul 06 17:45:22.721510 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.721474 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:22.810392 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.810356 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="759a64f8-de5d-485d-a519-89a5fa873021" path="/var/lib/kubelet/pods/759a64f8-de5d-485d-a519-89a5fa873021/volumes" Jul 06 17:45:22.932656 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.932622 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:22.956087 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.956057 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5"] Jul 06 17:45:22.956395 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.956382 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759a64f8-de5d-485d-a519-89a5fa873021" containerName="registry" Jul 06 17:45:22.956438 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.956399 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="759a64f8-de5d-485d-a519-89a5fa873021" containerName="registry" Jul 06 17:45:22.956484 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.956474 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="759a64f8-de5d-485d-a519-89a5fa873021" containerName="registry" Jul 06 17:45:22.962622 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.962599 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:22.965942 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.965923 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 17:45:22.966058 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.965969 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 17:45:22.967320 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.967299 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 17:45:22.967463 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.967445 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 17:45:22.967625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.967608 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qwgkw\"" Jul 06 17:45:22.967698 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.967671 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 17:45:22.971584 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.971519 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dbt2w"] Jul 06 17:45:22.975158 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.975005 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf"] Jul 06 17:45:22.975263 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.975200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:22.978024 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.978008 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 17:45:22.978217 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.978196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:22.978320 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.978119 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5"] Jul 06 17:45:22.978493 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.978400 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 17:45:22.978744 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.978725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jpmth\"" Jul 06 17:45:22.978855 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.978842 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 17:45:22.982097 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.982077 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-45rxw\"" Jul 06 17:45:22.982236 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.982222 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 17:45:22.982529 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.982261 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 17:45:22.982654 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.982641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 17:45:22.992060 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.992037 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf"] Jul 06 17:45:22.996230 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:22.996350 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwlxq\" (UniqueName: \"kubernetes.io/projected/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-api-access-rwlxq\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:22.996350 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tltb5\" (UniqueName: \"kubernetes.io/projected/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-kube-api-access-tltb5\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:22.996473 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/174d2424-309a-4ea7-85d4-15db385fedf8-root\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:22.996473 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/174d2424-309a-4ea7-85d4-15db385fedf8-metrics-client-ca\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:22.996473 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:22.996473 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-wtmp\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:22.996693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxfxc\" (UniqueName: \"kubernetes.io/projected/174d2424-309a-4ea7-85d4-15db385fedf8-kube-api-access-lxfxc\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:22.996693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:22.996693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-textfile\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:22.996693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:22.996877 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:22.996877 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:22.996877 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-accelerators-collector-config\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:22.996877 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:22.996877 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:22.996877 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/174d2424-309a-4ea7-85d4-15db385fedf8-sys\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:22.997069 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:22.997069 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:22.996923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-tls\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.020731 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.020699 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:23.098068 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.098272 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-tls\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.098272 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.098272 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwlxq\" (UniqueName: \"kubernetes.io/projected/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-api-access-rwlxq\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.098272 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tltb5\" (UniqueName: \"kubernetes.io/projected/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-kube-api-access-tltb5\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.098272 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/174d2424-309a-4ea7-85d4-15db385fedf8-root\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.098272 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098226 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/174d2424-309a-4ea7-85d4-15db385fedf8-metrics-client-ca\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.098272 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-wtmp\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxfxc\" (UniqueName: \"kubernetes.io/projected/174d2424-309a-4ea7-85d4-15db385fedf8-kube-api-access-lxfxc\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-textfile\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098471 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/174d2424-309a-4ea7-85d4-15db385fedf8-root\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098523 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-accelerators-collector-config\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.098661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.099134 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.099134 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/174d2424-309a-4ea7-85d4-15db385fedf8-sys\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.099134 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-wtmp\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.099134 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.098807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/174d2424-309a-4ea7-85d4-15db385fedf8-sys\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.099134 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.099018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/174d2424-309a-4ea7-85d4-15db385fedf8-metrics-client-ca\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.099371 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.099150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.099371 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:23.099235 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 17:45:23.099371 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:23.099284 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-tls podName:174d2424-309a-4ea7-85d4-15db385fedf8 nodeName:}" failed. No retries permitted until 2026-07-06 17:45:23.599267819 +0000 UTC m=+291.309152353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-tls") pod "node-exporter-dbt2w" (UID: "174d2424-309a-4ea7-85d4-15db385fedf8") : secret "node-exporter-tls" not found Jul 06 17:45:23.099531 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.099491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.100273 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.100251 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-textfile\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.102146 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:23.100527 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 06 17:45:23.102251 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:23.102193 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-tls podName:03222d6b-02a9-4ad3-ab5c-30f69ab1af5d nodeName:}" failed. No retries permitted until 2026-07-06 17:45:23.60217525 +0000 UTC m=+291.312059786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-68mkf" (UID: "03222d6b-02a9-4ad3-ab5c-30f69ab1af5d") : secret "kube-state-metrics-tls" not found Jul 06 17:45:23.102251 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.101565 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.102251 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.102009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.102251 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.102077 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.102251 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.100956 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-accelerators-collector-config\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.102251 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:23.101867 2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 17:45:23.102584 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:23.102274 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-openshift-state-metrics-tls podName:d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b nodeName:}" failed. No retries permitted until 2026-07-06 17:45:23.602264797 +0000 UTC m=+291.312149330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-8vjj5" (UID: "d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b") : secret "openshift-state-metrics-tls" not found Jul 06 17:45:23.102584 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.102399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.103133 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.103113 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.110206 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.110165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxfxc\" (UniqueName: \"kubernetes.io/projected/174d2424-309a-4ea7-85d4-15db385fedf8-kube-api-access-lxfxc\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.111818 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.111794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tltb5\" (UniqueName: \"kubernetes.io/projected/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-kube-api-access-tltb5\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.112348 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.112329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwlxq\" (UniqueName: \"kubernetes.io/projected/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-api-access-rwlxq\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.180465 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.180425 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:23.280315 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.280189 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:23.421365 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.421327 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:23.522430 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.522400 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:23.604227 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.604143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-tls\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.604358 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.604226 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.604358 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.604252 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.606658 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.606633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/174d2424-309a-4ea7-85d4-15db385fedf8-node-exporter-tls\") pod \"node-exporter-dbt2w\" (UID: \"174d2424-309a-4ea7-85d4-15db385fedf8\") " pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.606771 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.606702 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/03222d6b-02a9-4ad3-ab5c-30f69ab1af5d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-68mkf\" (UID: \"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.606827 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.606779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-8vjj5\" (UID: \"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.622792 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.622769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:23.679857 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.679824 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:23.843231 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.843194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:23.874243 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.874181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" Jul 06 17:45:23.888263 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.888232 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dbt2w" Jul 06 17:45:23.896226 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.896208 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" Jul 06 17:45:23.898434 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:23.898406 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174d2424_309a_4ea7_85d4_15db385fedf8.slice/crio-1a5a737016461ffad911bab51da269ac242da68a3c3c6ac56b68c72e3894cc1c WatchSource:0}: Error finding container 1a5a737016461ffad911bab51da269ac242da68a3c3c6ac56b68c72e3894cc1c: Status 404 returned error can't find the container with id 1a5a737016461ffad911bab51da269ac242da68a3c3c6ac56b68c72e3894cc1c Jul 06 17:45:23.951500 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:23.951469 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:24.022699 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.022524 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5"] Jul 06 17:45:24.025190 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:24.025158 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd196fbff_e6ac_410d_bbf0_9fd2bfaddc0b.slice/crio-cab43ccfd04b5d5f494d8ce72a9f6be14abb6572025b5ad2b98d68cc76bbe5d3 WatchSource:0}: Error finding container cab43ccfd04b5d5f494d8ce72a9f6be14abb6572025b5ad2b98d68cc76bbe5d3: Status 404 returned error can't find the container with id cab43ccfd04b5d5f494d8ce72a9f6be14abb6572025b5ad2b98d68cc76bbe5d3 Jul 06 17:45:24.032839 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.032816 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:24.039194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.039172 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:45:24.043076 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.043055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.046014 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.045990 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 17:45:24.046110 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.046020 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-978x7\"" Jul 06 17:45:24.046310 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.046289 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 17:45:24.046486 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.046473 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 17:45:24.046684 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.046665 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 17:45:24.046795 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.046779 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 17:45:24.047005 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.046987 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 17:45:24.047145 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.047125 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 17:45:24.047215 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.047125 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 17:45:24.047607 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.047588 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 17:45:24.058423 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.058402 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf"] Jul 06 17:45:24.060056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.060034 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:45:24.064809 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:24.064784 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03222d6b_02a9_4ad3_ab5c_30f69ab1af5d.slice/crio-ec9a597f3f2704c41a73fa2bd08f1114ea68f6e20a7070ade5cfcb29f0e13f77 WatchSource:0}: Error finding container ec9a597f3f2704c41a73fa2bd08f1114ea68f6e20a7070ade5cfcb29f0e13f77: Status 404 returned error can't find the container with id ec9a597f3f2704c41a73fa2bd08f1114ea68f6e20a7070ade5cfcb29f0e13f77 Jul 06 17:45:24.109105 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh6ng\" (UniqueName: \"kubernetes.io/projected/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-kube-api-access-nh6ng\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109225 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109225 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109225 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109225 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109430 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109430 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109430 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109430 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-web-config\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109678 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-config-out\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109678 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109756 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.109803 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.109761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.210836 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.210806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.210976 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.210863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh6ng\" (UniqueName: \"kubernetes.io/projected/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-kube-api-access-nh6ng\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.210976 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.210900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.210976 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.210937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.211066 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.210964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.211066 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.211007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.211138 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:24.211098 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 17:45:24.211179 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:24.211160 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-main-tls podName:1ea1dd8c-fe42-44d1-8660-a50bd34a18e7 nodeName:}" failed. No retries permitted until 2026-07-06 17:45:24.711139879 +0000 UTC m=+292.421024414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1ea1dd8c-fe42-44d1-8660-a50bd34a18e7") : secret "alertmanager-main-tls" not found Jul 06 17:45:24.211231 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.211200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.211280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.211255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.211334 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.211289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.211482 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:24.211467 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-alertmanager-trusted-ca-bundle podName:1ea1dd8c-fe42-44d1-8660-a50bd34a18e7 nodeName:}" failed. No retries permitted until 2026-07-06 17:45:24.711449684 +0000 UTC m=+292.421334221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1ea1dd8c-fe42-44d1-8660-a50bd34a18e7") : configmap references non-existent config key: ca-bundle.crt Jul 06 17:45:24.211703 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.211678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.212168 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.212138 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.212266 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.212225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-web-config\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.212631 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.212609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-config-out\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.212708 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.212661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.212775 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.212707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.213784 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.213757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.214708 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.214661 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.214708 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.214671 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.215039 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.215019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-web-config\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.215320 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.215286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-config-out\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.215633 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.215616 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.215949 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.215931 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.215989 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.215939 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.220827 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.220807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh6ng\" (UniqueName: \"kubernetes.io/projected/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-kube-api-access-nh6ng\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.350812 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.350780 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:24.716945 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.716909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.717105 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.716987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.717854 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.717833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.719278 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.719258 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ea1dd8c-fe42-44d1-8660-a50bd34a18e7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:24.813936 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.813837 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbt2w" event={"ID":"174d2424-309a-4ea7-85d4-15db385fedf8","Type":"ContainerStarted","Data":"1a5a737016461ffad911bab51da269ac242da68a3c3c6ac56b68c72e3894cc1c"} Jul 06 17:45:24.813936 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.813885 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" event={"ID":"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b","Type":"ContainerStarted","Data":"1b88c39ca282fa9179b3f17f7e8c32c1f8fb9fd300f54133b6801f01986ba7f0"} Jul 06 17:45:24.813936 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.813908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" event={"ID":"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b","Type":"ContainerStarted","Data":"444e22861efdb318dab3c6661af8bdb7bc4e5f35827e829a1a433cf293011418"} Jul 06 17:45:24.813936 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.813925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" event={"ID":"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b","Type":"ContainerStarted","Data":"cab43ccfd04b5d5f494d8ce72a9f6be14abb6572025b5ad2b98d68cc76bbe5d3"} Jul 06 17:45:24.813936 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.813941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" event={"ID":"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d","Type":"ContainerStarted","Data":"ec9a597f3f2704c41a73fa2bd08f1114ea68f6e20a7070ade5cfcb29f0e13f77"} Jul 06 17:45:24.968706 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:24.968624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:45:25.141424 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:25.141392 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:45:25.251418 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:25.251339 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea1dd8c_fe42_44d1_8660_a50bd34a18e7.slice/crio-35742697d57905744840b9252cde6fa90274e9c8b8383becb844fac90d4468e4 WatchSource:0}: Error finding container 35742697d57905744840b9252cde6fa90274e9c8b8383becb844fac90d4468e4: Status 404 returned error can't find the container with id 35742697d57905744840b9252cde6fa90274e9c8b8383becb844fac90d4468e4 Jul 06 17:45:25.816742 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:25.816705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7","Type":"ContainerStarted","Data":"35742697d57905744840b9252cde6fa90274e9c8b8383becb844fac90d4468e4"} Jul 06 17:45:25.912314 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:25.912276 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.014524 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.014441 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.089234 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.086928 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-847879ff66-fp6ld"] Jul 06 17:45:26.094716 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.092988 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.098789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.097125 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cplqt\"" Jul 06 17:45:26.098789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.097394 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 17:45:26.098789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.097605 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dgqnch4vf65s\"" Jul 06 17:45:26.098789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.097768 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 17:45:26.098789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.097957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 17:45:26.098789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.098139 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 17:45:26.098789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.098176 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-847879ff66-fp6ld"] Jul 06 17:45:26.098789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.098312 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 17:45:26.129393 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.128935 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-grpc-tls\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.129393 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.129003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.129393 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.129206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-tls\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.129393 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.129308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.130056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.129349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.130056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.129530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.130056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.129689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/665cda69-52f1-4427-b71e-e2190b381a24-metrics-client-ca\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.130056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.129733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btszr\" (UniqueName: \"kubernetes.io/projected/665cda69-52f1-4427-b71e-e2190b381a24-kube-api-access-btszr\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.231563 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.230910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-tls\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.231563 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.230953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.231563 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.230982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.231563 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.231006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.231563 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.231030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/665cda69-52f1-4427-b71e-e2190b381a24-metrics-client-ca\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.231563 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.231057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btszr\" (UniqueName: \"kubernetes.io/projected/665cda69-52f1-4427-b71e-e2190b381a24-kube-api-access-btszr\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.231563 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.231165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-grpc-tls\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.232425 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.232307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/665cda69-52f1-4427-b71e-e2190b381a24-metrics-client-ca\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.232425 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.232320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.232608 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.232464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.235580 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.235424 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-grpc-tls\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.236087 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.235946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.236087 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.235994 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.236087 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.236043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.237316 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.237278 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-tls\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.237412 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.237390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/665cda69-52f1-4427-b71e-e2190b381a24-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.240694 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.240673 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btszr\" (UniqueName: \"kubernetes.io/projected/665cda69-52f1-4427-b71e-e2190b381a24-kube-api-access-btszr\") pod \"thanos-querier-847879ff66-fp6ld\" (UID: \"665cda69-52f1-4427-b71e-e2190b381a24\") " pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.332756 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.332664 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.453633 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.453605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:26.821753 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.821718 2577 generic.go:356] "Generic (PLEG): container finished" podID="174d2424-309a-4ea7-85d4-15db385fedf8" containerID="7c17cf588b666a0f6a418eff572a4aa0864bf8f46b0e82f428b81de3b13e0d13" exitCode=0 Jul 06 17:45:26.821870 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.821797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbt2w" event={"ID":"174d2424-309a-4ea7-85d4-15db385fedf8","Type":"ContainerDied","Data":"7c17cf588b666a0f6a418eff572a4aa0864bf8f46b0e82f428b81de3b13e0d13"} Jul 06 17:45:26.824453 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.824293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7","Type":"ContainerStarted","Data":"8db213033a25d29b1fb4a11998f41cd9520d56127d7362380401a60ec0d081b7"} Jul 06 17:45:26.826513 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.826490 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-847879ff66-fp6ld"] Jul 06 17:45:26.827389 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.827363 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" event={"ID":"d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b","Type":"ContainerStarted","Data":"fa07744c8aaeae16131f734e4676110d37655246058ba2085cbeadfc17b8bfc5"} Jul 06 17:45:26.827832 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:26.827801 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665cda69_52f1_4427_b71e_e2190b381a24.slice/crio-656661426d6d6571e4a105315ad1de4140b064a971036ea76d45fe105b6a91bd WatchSource:0}: Error finding container 656661426d6d6571e4a105315ad1de4140b064a971036ea76d45fe105b6a91bd: Status 404 returned error can't find the container with id 656661426d6d6571e4a105315ad1de4140b064a971036ea76d45fe105b6a91bd Jul 06 17:45:26.829586 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.829563 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" event={"ID":"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d","Type":"ContainerStarted","Data":"bcd184c052d8ae617c1f21ce1b12578a229debd8cfd765f531f3bdce146382d2"} Jul 06 17:45:26.829656 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.829617 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" event={"ID":"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d","Type":"ContainerStarted","Data":"2a13c0db35e1267bbf0f9dc28aadb92f2a70895179ecb6b997ba88c0d4855c89"} Jul 06 17:45:26.829656 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.829647 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" event={"ID":"03222d6b-02a9-4ad3-ab5c-30f69ab1af5d","Type":"ContainerStarted","Data":"4d51b6e9bbaea76e2d9b9bd98b7e2db322d64a2135ffd3474dffcfc297ff5fac"} Jul 06 17:45:26.858418 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.858371 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-68mkf" podStartSLOduration=3.07926941 podStartE2EDuration="4.858356541s" totalImagesPullingTime="1.779087131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:26.857408992 +0000 UTC m=+294.567293541" watchObservedRunningTime="2026-07-06 17:45:26.858356541 +0000 UTC m=+294.568241092" Jul 06 17:45:26.876065 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:26.876016 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-8vjj5" podStartSLOduration=3.200415998 podStartE2EDuration="4.87600203s" totalImagesPullingTime="1.675586032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:26.875187562 +0000 UTC m=+294.585072115" watchObservedRunningTime="2026-07-06 17:45:26.87600203 +0000 UTC m=+294.585886582" Jul 06 17:45:27.134813 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.134778 2577 patch_prober.go:28] interesting pod/console-6cbf5bd8d5-wp6l7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jul 06 17:45:27.135148 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.134832 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cbf5bd8d5-wp6l7" podUID="74b57821-2421-489f-922b-d2095104f1a7" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jul 06 17:45:27.281312 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.281228 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64b848bcd9-zcxf5"] Jul 06 17:45:27.284499 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.284475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.287974 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.287950 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 17:45:27.287974 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.287966 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-67664\"" Jul 06 17:45:27.288126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.287976 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 17:45:27.288126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.287980 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 17:45:27.288126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.287992 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 17:45:27.288126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.288077 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dlajqksufbnst\"" Jul 06 17:45:27.294910 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.294889 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64b848bcd9-zcxf5"] Jul 06 17:45:27.342225 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.342196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-secret-metrics-server-client-certs\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.342402 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.342237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-secret-metrics-server-tls\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.342402 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.342259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.342402 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.342275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-audit-log\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.342402 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.342290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-client-ca-bundle\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.342402 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.342353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm2lc\" (UniqueName: \"kubernetes.io/projected/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-kube-api-access-mm2lc\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.342604 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.342402 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-metrics-server-audit-profiles\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.443527 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.443481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm2lc\" (UniqueName: \"kubernetes.io/projected/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-kube-api-access-mm2lc\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.443690 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.443541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-metrics-server-audit-profiles\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.443690 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.443617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-secret-metrics-server-client-certs\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.443690 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.443647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-secret-metrics-server-tls\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.443690 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.443676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.443690 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.443692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-audit-log\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.443966 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.443709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-client-ca-bundle\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.444194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.444173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-audit-log\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.444448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.444427 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.444594 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.444575 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-metrics-server-audit-profiles\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.446189 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.446168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-secret-metrics-server-client-certs\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.447050 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.447033 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-secret-metrics-server-tls\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.447123 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.447052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-client-ca-bundle\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.451324 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.451302 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm2lc\" (UniqueName: \"kubernetes.io/projected/267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd-kube-api-access-mm2lc\") pod \"metrics-server-64b848bcd9-zcxf5\" (UID: \"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd\") " pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.594923 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.594840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:27.730819 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.730786 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64b848bcd9-zcxf5"] Jul 06 17:45:27.734757 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:27.734725 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267f4217_dcf3_4c4a_b6c5_afbe2ff6aebd.slice/crio-4a74f6bf526e4ad0c0b598acd39a7f93b3d3ae6bad586a2380ee602f46e6019c WatchSource:0}: Error finding container 4a74f6bf526e4ad0c0b598acd39a7f93b3d3ae6bad586a2380ee602f46e6019c: Status 404 returned error can't find the container with id 4a74f6bf526e4ad0c0b598acd39a7f93b3d3ae6bad586a2380ee602f46e6019c Jul 06 17:45:27.764223 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.764181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:27.771716 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.771692 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph"] Jul 06 17:45:27.776597 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.776575 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:27.779390 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.779367 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 17:45:27.779510 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.779481 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rl5gn\"" Jul 06 17:45:27.785133 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.785051 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph"] Jul 06 17:45:27.808516 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.808491 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66968fffc-slqpq"] Jul 06 17:45:27.811997 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.811976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.822304 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.822283 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66968fffc-slqpq"] Jul 06 17:45:27.835431 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.835403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbt2w" event={"ID":"174d2424-309a-4ea7-85d4-15db385fedf8","Type":"ContainerStarted","Data":"97c672219c7daceaeb0138ff7c913d9e827d3d7c7f087d31da4d0bdf14a61b5d"} Jul 06 17:45:27.835534 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.835459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dbt2w" event={"ID":"174d2424-309a-4ea7-85d4-15db385fedf8","Type":"ContainerStarted","Data":"2e3d429e7757516b9e271735d3699aebc20a8f3806f6fc7242c07e32217e6c74"} Jul 06 17:45:27.836513 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.836492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" event={"ID":"665cda69-52f1-4427-b71e-e2190b381a24","Type":"ContainerStarted","Data":"656661426d6d6571e4a105315ad1de4140b064a971036ea76d45fe105b6a91bd"} Jul 06 17:45:27.837526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.837500 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:27.838089 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.838070 2577 generic.go:356] "Generic (PLEG): container finished" podID="1ea1dd8c-fe42-44d1-8660-a50bd34a18e7" containerID="8db213033a25d29b1fb4a11998f41cd9520d56127d7362380401a60ec0d081b7" exitCode=0 Jul 06 17:45:27.838172 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.838151 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7","Type":"ContainerDied","Data":"8db213033a25d29b1fb4a11998f41cd9520d56127d7362380401a60ec0d081b7"} Jul 06 17:45:27.839416 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.839398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" event={"ID":"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd","Type":"ContainerStarted","Data":"4a74f6bf526e4ad0c0b598acd39a7f93b3d3ae6bad586a2380ee602f46e6019c"} Jul 06 17:45:27.847335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.847283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-trusted-ca-bundle\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.847335 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.847311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-oauth-serving-cert\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.847442 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.847337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-serving-cert\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.847442 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.847404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-oauth-config\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.847442 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.847433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4nn6\" (UniqueName: \"kubernetes.io/projected/802290e6-9893-4b72-b991-9543581ebea2-kube-api-access-q4nn6\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.847540 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.847449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp7lf\" (UniqueName: \"kubernetes.io/projected/075a5193-263e-4d8d-bbd8-2d3e5ea2059f-kube-api-access-qp7lf\") pod \"monitoring-plugin-d5dcff7cf-l28ph\" (UID: \"075a5193-263e-4d8d-bbd8-2d3e5ea2059f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:27.847540 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.847471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-service-ca\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.847620 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.847540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/075a5193-263e-4d8d-bbd8-2d3e5ea2059f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l28ph\" (UID: \"075a5193-263e-4d8d-bbd8-2d3e5ea2059f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:27.847620 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.847587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-console-config\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.854631 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.854597 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dbt2w" podStartSLOduration=3.801668718 podStartE2EDuration="5.85458532s" totalImagesPullingTime="1.94334342s" totalInitContainerRuntime="109.573182ms" isStatefulPod=true podCreationTimestamp="2026-07-06 17:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:27.853725497 +0000 UTC m=+295.563610049" watchObservedRunningTime="2026-07-06 17:45:27.85458532 +0000 UTC m=+295.564469871" Jul 06 17:45:27.943947 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.943918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:27.948944 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.948917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-oauth-config\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.949507 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.948958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4nn6\" (UniqueName: \"kubernetes.io/projected/802290e6-9893-4b72-b991-9543581ebea2-kube-api-access-q4nn6\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.949507 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.948986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp7lf\" (UniqueName: \"kubernetes.io/projected/075a5193-263e-4d8d-bbd8-2d3e5ea2059f-kube-api-access-qp7lf\") pod \"monitoring-plugin-d5dcff7cf-l28ph\" (UID: \"075a5193-263e-4d8d-bbd8-2d3e5ea2059f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:27.949507 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.949047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-service-ca\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.949507 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.949125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/075a5193-263e-4d8d-bbd8-2d3e5ea2059f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l28ph\" (UID: \"075a5193-263e-4d8d-bbd8-2d3e5ea2059f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:27.949507 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.949241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-console-config\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.949507 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.949446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-trusted-ca-bundle\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.949962 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.949526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-oauth-serving-cert\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.949962 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.949621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-serving-cert\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.951443 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.950682 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-oauth-serving-cert\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.951443 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.950768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-trusted-ca-bundle\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.951443 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.951386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-service-ca\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.951901 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.951861 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-console-config\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.953265 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.953243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-serving-cert\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.953410 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.953389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/075a5193-263e-4d8d-bbd8-2d3e5ea2059f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l28ph\" (UID: \"075a5193-263e-4d8d-bbd8-2d3e5ea2059f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:27.953575 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.953538 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-oauth-config\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.960921 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.960876 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4nn6\" (UniqueName: \"kubernetes.io/projected/802290e6-9893-4b72-b991-9543581ebea2-kube-api-access-q4nn6\") pod \"console-66968fffc-slqpq\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:27.961206 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:27.961181 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp7lf\" (UniqueName: \"kubernetes.io/projected/075a5193-263e-4d8d-bbd8-2d3e5ea2059f-kube-api-access-qp7lf\") pod \"monitoring-plugin-d5dcff7cf-l28ph\" (UID: \"075a5193-263e-4d8d-bbd8-2d3e5ea2059f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:28.088147 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:28.088117 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:28.123628 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:28.123593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:28.250668 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:28.250637 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph"] Jul 06 17:45:28.295974 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:28.295951 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66968fffc-slqpq"] Jul 06 17:45:28.298070 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:45:28.298039 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802290e6_9893_4b72_b991_9543581ebea2.slice/crio-e8446ec89f2e205622baf07a629a7184cb26f6776b1d3d52a3eacdd14af69db3 WatchSource:0}: Error finding container e8446ec89f2e205622baf07a629a7184cb26f6776b1d3d52a3eacdd14af69db3: Status 404 returned error can't find the container with id e8446ec89f2e205622baf07a629a7184cb26f6776b1d3d52a3eacdd14af69db3 Jul 06 17:45:28.807114 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:45:28.807074 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7jgm5" podUID="6f08132d-2a61-4afc-b235-98fe6694c5cb" Jul 06 17:45:28.847113 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:28.847068 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" event={"ID":"075a5193-263e-4d8d-bbd8-2d3e5ea2059f","Type":"ContainerStarted","Data":"f6c56024bba3e790ab4a705711bfd3e018967169795da116ed7ac9a1aea50294"} Jul 06 17:45:28.849448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:28.849352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66968fffc-slqpq" event={"ID":"802290e6-9893-4b72-b991-9543581ebea2","Type":"ContainerStarted","Data":"d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4"} Jul 06 17:45:28.849448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:28.849410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66968fffc-slqpq" event={"ID":"802290e6-9893-4b72-b991-9543581ebea2","Type":"ContainerStarted","Data":"e8446ec89f2e205622baf07a629a7184cb26f6776b1d3d52a3eacdd14af69db3"} Jul 06 17:45:28.870347 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:28.870301 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66968fffc-slqpq" podStartSLOduration=1.870280888 podStartE2EDuration="1.870280888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:28.868348797 +0000 UTC m=+296.578233351" watchObservedRunningTime="2026-07-06 17:45:28.870280888 +0000 UTC m=+296.580165440" Jul 06 17:45:29.186775 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:29.186736 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:30.796121 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.796096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rv48c" Jul 06 17:45:30.862981 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.862944 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" event={"ID":"665cda69-52f1-4427-b71e-e2190b381a24","Type":"ContainerStarted","Data":"3f5ba09e90571359d8adc463e997a4486872644579d93ce48e6149004a06d18b"} Jul 06 17:45:30.863085 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.863037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" event={"ID":"665cda69-52f1-4427-b71e-e2190b381a24","Type":"ContainerStarted","Data":"d7eb3bff214fe6c51fdea7a4b11c9fbcc1cc0c40bb3d0a95d6f4d8efc9812694"} Jul 06 17:45:30.863143 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.863084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" event={"ID":"665cda69-52f1-4427-b71e-e2190b381a24","Type":"ContainerStarted","Data":"acbc69151227deee350aba21cda661cf4d91b04d888e4e0a63250be3de7a1782"} Jul 06 17:45:30.867467 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.867444 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7","Type":"ContainerStarted","Data":"b4c01a2be4a4206b6b7786f8f92cb9c5edc4820663018d6e3e2afd347954a065"} Jul 06 17:45:30.867652 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.867508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7","Type":"ContainerStarted","Data":"428ed88c5fe5c75a030c805dac1e928e13f6da26f7f80659e379fb6f5f03813f"} Jul 06 17:45:30.867652 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.867534 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7","Type":"ContainerStarted","Data":"356a9da8881182de9bd6b25601d375dab78778cc54602f9d56d0faa21bcd8605"} Jul 06 17:45:30.867652 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.867580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7","Type":"ContainerStarted","Data":"6d8259ddcc369b84e2dffb31babac31be4f9ad99d3e18b9e1a821260dbcf8960"} Jul 06 17:45:30.869708 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.869686 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" event={"ID":"267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd","Type":"ContainerStarted","Data":"487b1a35c7b0bdde7867de5e3c33004c90943f77c54aff3e97a55ba1c6af3f2d"} Jul 06 17:45:30.891605 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:30.891537 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" podStartSLOduration=1.468005886 podStartE2EDuration="3.891518281s" totalImagesPullingTime="2.423512395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:30.889828099 +0000 UTC m=+298.599712653" watchObservedRunningTime="2026-07-06 17:45:30.891518281 +0000 UTC m=+298.601402832" Jul 06 17:45:31.496985 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.496903 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:31.545661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.545630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:31.875956 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.875855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" event={"ID":"075a5193-263e-4d8d-bbd8-2d3e5ea2059f","Type":"ContainerStarted","Data":"0a3ff88181b9a644650c279c0466dee3af07903acfef6e796f54b844c5f98372"} Jul 06 17:45:31.875956 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.875928 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:31.879029 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.879001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" event={"ID":"665cda69-52f1-4427-b71e-e2190b381a24","Type":"ContainerStarted","Data":"f3dd4d84fcad20236886df53ed4d8c0137241c599b8bc941c81d1ca0877a92ba"} Jul 06 17:45:31.879163 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.879072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" event={"ID":"665cda69-52f1-4427-b71e-e2190b381a24","Type":"ContainerStarted","Data":"31735f244164cacb7a560bd319cb7deeeecd2d2b2ab5471b844cd1887425660a"} Jul 06 17:45:31.879163 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.879123 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:31.879269 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.879163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" event={"ID":"665cda69-52f1-4427-b71e-e2190b381a24","Type":"ContainerStarted","Data":"e8c709a82247ca98cfe9aedbc07a1ad1d5f33dec9da76160e96ab321d682e756"} Jul 06 17:45:31.881224 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.881205 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" Jul 06 17:45:31.882291 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.882268 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7","Type":"ContainerStarted","Data":"c475902b6354ada45d95fb146355979cd7e847f5a535369e15b22c3a71921595"} Jul 06 17:45:31.882408 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.882330 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ea1dd8c-fe42-44d1-8660-a50bd34a18e7","Type":"ContainerStarted","Data":"e529e2442fac28db2112bf9d94ee19e9f2cb2129b21ed4b6e8e0a69f9c5459a5"} Jul 06 17:45:31.892731 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.892693 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l28ph" podStartSLOduration=2.3574116050000002 podStartE2EDuration="4.892679536s" totalImagesPullingTime="2.535267931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:31.891870127 +0000 UTC m=+299.601754693" watchObservedRunningTime="2026-07-06 17:45:31.892679536 +0000 UTC m=+299.602564088" Jul 06 17:45:31.931959 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.931903 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" podStartSLOduration=1.731587823 podStartE2EDuration="5.931887483s" totalImagesPullingTime="4.20029966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:31.930629041 +0000 UTC m=+299.640513594" watchObservedRunningTime="2026-07-06 17:45:31.931887483 +0000 UTC m=+299.641772056" Jul 06 17:45:31.955661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:31.955616 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.730158758 podStartE2EDuration="7.955599607s" totalImagesPullingTime="4.205145334s" totalInitContainerRuntime="20.295515ms" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:31.953837746 +0000 UTC m=+299.663722299" watchObservedRunningTime="2026-07-06 17:45:31.955599607 +0000 UTC m=+299.665484158" Jul 06 17:45:32.710251 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:32.710228 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 17:45:33.115600 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:33.115494 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:33.168379 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:33.168344 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:33.431259 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:33.431159 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:33.482704 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:33.482673 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:36.068566 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:36.068508 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:36.168901 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:36.168860 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:37.039910 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:37.039878 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:37.137923 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:37.137899 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:37.141835 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:37.141812 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:45:37.293124 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:37.293038 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:37.392832 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:37.392797 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:37.892364 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:37.892339 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-847879ff66-fp6ld" Jul 06 17:45:38.123810 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:38.123781 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:38.123983 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:38.123838 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:38.128597 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:38.128574 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:38.734728 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:38.734690 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:38.788802 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:38.788769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:38.913747 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:38.913722 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:45:38.958022 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:38.957986 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cbf5bd8d5-wp6l7"] Jul 06 17:45:39.060557 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:39.060450 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:39.115978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:39.115945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:40.568252 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:40.568217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:40.619410 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:40.619363 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:41.806442 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:41.806408 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:45:45.652178 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:45.652132 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:45.713063 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:45.713013 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:45.798034 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:45.798002 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:45.898174 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:45.898135 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:46.080374 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:46.080336 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:46.182038 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:46.182000 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:47.595651 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:47.595617 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:47.596025 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:47.595679 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:45:48.739226 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:48.739196 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x6vm5_e2494827-dc7f-402b-bf10-aae6a568d847/serve-healthcheck-canary/0.log" Jul 06 17:45:54.654073 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:54.654036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:54.703339 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:45:54.703283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:01.512731 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:01.512701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:01.613515 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:01.613479 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:03.982312 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:03.982259 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cbf5bd8d5-wp6l7" podUID="74b57821-2421-489f-922b-d2095104f1a7" containerName="console" containerID="cri-o://b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e" gracePeriod=15 Jul 06 17:46:04.246167 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.246089 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:46:04.293378 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293342 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-trusted-ca-bundle\") pod \"74b57821-2421-489f-922b-d2095104f1a7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " Jul 06 17:46:04.293562 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293393 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-oauth-serving-cert\") pod \"74b57821-2421-489f-922b-d2095104f1a7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " Jul 06 17:46:04.293562 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293432 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-console-config\") pod \"74b57821-2421-489f-922b-d2095104f1a7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " Jul 06 17:46:04.293562 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293464 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sn29\" (UniqueName: \"kubernetes.io/projected/74b57821-2421-489f-922b-d2095104f1a7-kube-api-access-6sn29\") pod \"74b57821-2421-489f-922b-d2095104f1a7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " Jul 06 17:46:04.293562 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293508 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-service-ca\") pod \"74b57821-2421-489f-922b-d2095104f1a7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " Jul 06 17:46:04.293562 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293559 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-serving-cert\") pod \"74b57821-2421-489f-922b-d2095104f1a7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " Jul 06 17:46:04.293838 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293595 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-oauth-config\") pod \"74b57821-2421-489f-922b-d2095104f1a7\" (UID: \"74b57821-2421-489f-922b-d2095104f1a7\") " Jul 06 17:46:04.293838 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293731 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "74b57821-2421-489f-922b-d2095104f1a7" (UID: "74b57821-2421-489f-922b-d2095104f1a7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:46:04.293943 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293856 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-trusted-ca-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:46:04.293943 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293888 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74b57821-2421-489f-922b-d2095104f1a7" (UID: "74b57821-2421-489f-922b-d2095104f1a7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:46:04.293943 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293909 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-console-config" (OuterVolumeSpecName: "console-config") pod "74b57821-2421-489f-922b-d2095104f1a7" (UID: "74b57821-2421-489f-922b-d2095104f1a7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:46:04.294044 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.293971 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-service-ca" (OuterVolumeSpecName: "service-ca") pod "74b57821-2421-489f-922b-d2095104f1a7" (UID: "74b57821-2421-489f-922b-d2095104f1a7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:46:04.295879 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.295853 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74b57821-2421-489f-922b-d2095104f1a7" (UID: "74b57821-2421-489f-922b-d2095104f1a7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:46:04.295879 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.295875 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b57821-2421-489f-922b-d2095104f1a7-kube-api-access-6sn29" (OuterVolumeSpecName: "kube-api-access-6sn29") pod "74b57821-2421-489f-922b-d2095104f1a7" (UID: "74b57821-2421-489f-922b-d2095104f1a7"). InnerVolumeSpecName "kube-api-access-6sn29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:46:04.296018 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.295907 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74b57821-2421-489f-922b-d2095104f1a7" (UID: "74b57821-2421-489f-922b-d2095104f1a7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:46:04.394239 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.394204 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-console-config\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:46:04.394239 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.394233 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sn29\" (UniqueName: \"kubernetes.io/projected/74b57821-2421-489f-922b-d2095104f1a7-kube-api-access-6sn29\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:46:04.394239 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.394242 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-service-ca\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:46:04.394239 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.394251 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-serving-cert\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:46:04.394479 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.394261 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b57821-2421-489f-922b-d2095104f1a7-console-oauth-config\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:46:04.394479 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:04.394269 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b57821-2421-489f-922b-d2095104f1a7-oauth-serving-cert\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:46:05.013447 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:05.013410 2577 generic.go:356] "Generic (PLEG): container finished" podID="74b57821-2421-489f-922b-d2095104f1a7" containerID="b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e" exitCode=0 Jul 06 17:46:05.013883 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:05.013454 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbf5bd8d5-wp6l7" Jul 06 17:46:05.013883 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:05.013484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbf5bd8d5-wp6l7" event={"ID":"74b57821-2421-489f-922b-d2095104f1a7","Type":"ContainerDied","Data":"b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e"} Jul 06 17:46:05.013883 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:05.013529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbf5bd8d5-wp6l7" event={"ID":"74b57821-2421-489f-922b-d2095104f1a7","Type":"ContainerDied","Data":"3905c49ff1367a5d840d4f720de35bbf1be76db26a3e4c0bbc1ae43e3ed1fc19"} Jul 06 17:46:05.013883 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:05.013567 2577 scope.go:117] "RemoveContainer" containerID="b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e" Jul 06 17:46:05.022126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:05.022111 2577 scope.go:117] "RemoveContainer" containerID="b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e" Jul 06 17:46:05.022371 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:46:05.022353 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e\": container with ID starting with b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e not found: ID does not exist" containerID="b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e" Jul 06 17:46:05.022437 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:05.022379 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e"} err="failed to get container status \"b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e\": rpc error: code = NotFound desc = could not find container \"b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e\": container with ID starting with b238b84deb8f198ce0babe355daa03c7b944408d05ff92e2ffc0fb01ade8ee6e not found: ID does not exist" Jul 06 17:46:05.033319 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:05.033295 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cbf5bd8d5-wp6l7"] Jul 06 17:46:05.036248 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:05.036226 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cbf5bd8d5-wp6l7"] Jul 06 17:46:06.811584 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:06.811536 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b57821-2421-489f-922b-d2095104f1a7" path="/var/lib/kubelet/pods/74b57821-2421-489f-922b-d2095104f1a7/volumes" Jul 06 17:46:07.600885 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:07.600856 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:46:07.604624 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:07.604602 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64b848bcd9-zcxf5" Jul 06 17:46:08.026999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:08.026965 2577 generic.go:356] "Generic (PLEG): container finished" podID="3a23d1e9-e687-4bab-8ec5-a753fd1b7b48" containerID="da21fe106dd73280fed7c1bbce0be1826d095a80b3ccd4019634612ac9f2059f" exitCode=0 Jul 06 17:46:08.027373 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:08.027037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" event={"ID":"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48","Type":"ContainerDied","Data":"da21fe106dd73280fed7c1bbce0be1826d095a80b3ccd4019634612ac9f2059f"} Jul 06 17:46:08.027447 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:08.027433 2577 scope.go:117] "RemoveContainer" containerID="da21fe106dd73280fed7c1bbce0be1826d095a80b3ccd4019634612ac9f2059f" Jul 06 17:46:09.033619 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:09.033584 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lf2pj" event={"ID":"3a23d1e9-e687-4bab-8ec5-a753fd1b7b48","Type":"ContainerStarted","Data":"6388567fe9907735b98a274bae70068131b0163447a195310abceb0012879723"} Jul 06 17:46:09.034977 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:09.034951 2577 generic.go:356] "Generic (PLEG): container finished" podID="f9282c18-5570-49ab-828f-5cdd0b6d576f" containerID="163751349e366b09d4dfc9e95ac6b67b4078d6d722dd5e8278d5ef959e8435e5" exitCode=0 Jul 06 17:46:09.035108 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:09.035014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" event={"ID":"f9282c18-5570-49ab-828f-5cdd0b6d576f","Type":"ContainerDied","Data":"163751349e366b09d4dfc9e95ac6b67b4078d6d722dd5e8278d5ef959e8435e5"} Jul 06 17:46:09.035291 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:09.035278 2577 scope.go:117] "RemoveContainer" containerID="163751349e366b09d4dfc9e95ac6b67b4078d6d722dd5e8278d5ef959e8435e5" Jul 06 17:46:09.660280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:09.660245 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:09.719175 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:09.719139 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:10.040541 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:10.040509 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-wrrc7" event={"ID":"f9282c18-5570-49ab-828f-5cdd0b6d576f","Type":"ContainerStarted","Data":"55412c937d57f72328c561e2d47ee2ff5d1a4d5d1ccbc347d0a748b692feee74"} Jul 06 17:46:16.848173 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:16.848133 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:16.949939 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:16.949903 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:17.005595 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:17.005538 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:22.435078 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:22.435038 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:22.485487 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:22.485449 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:39.652089 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:39.652001 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:39.705916 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:39.705879 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:41.325571 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:41.325517 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:41.384621 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:41.384586 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:41.443068 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:41.443026 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:42.252836 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:42.252801 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:42.453234 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:42.453201 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:45.659752 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:45.659714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:46:45.661890 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:45.661865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f08132d-2a61-4afc-b235-98fe6694c5cb-metrics-certs\") pod \"network-metrics-daemon-7jgm5\" (UID: \"6f08132d-2a61-4afc-b235-98fe6694c5cb\") " pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:46:45.710435 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:45.710404 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gwzng\"" Jul 06 17:46:45.717866 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:45.717847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7jgm5" Jul 06 17:46:45.846624 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:45.846600 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7jgm5"] Jul 06 17:46:45.849352 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:46:45.849326 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f08132d_2a61_4afc_b235_98fe6694c5cb.slice/crio-90873134f4b5049ca597b75e82fc1367f1a649f2127050a8a15949ae7f96ce6b WatchSource:0}: Error finding container 90873134f4b5049ca597b75e82fc1367f1a649f2127050a8a15949ae7f96ce6b: Status 404 returned error can't find the container with id 90873134f4b5049ca597b75e82fc1367f1a649f2127050a8a15949ae7f96ce6b Jul 06 17:46:45.852002 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:45.851986 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:46:46.184502 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:46.184469 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7jgm5" event={"ID":"6f08132d-2a61-4afc-b235-98fe6694c5cb","Type":"ContainerStarted","Data":"90873134f4b5049ca597b75e82fc1367f1a649f2127050a8a15949ae7f96ce6b"} Jul 06 17:46:47.189988 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.189951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7jgm5" event={"ID":"6f08132d-2a61-4afc-b235-98fe6694c5cb","Type":"ContainerStarted","Data":"e1417d1f795f564d4940316bface582922de56a265664a6f10b9d045dbc3879f"} Jul 06 17:46:47.190384 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.190009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7jgm5" event={"ID":"6f08132d-2a61-4afc-b235-98fe6694c5cb","Type":"ContainerStarted","Data":"c1bf8bc1c7c3547732689f8a1b0a8b7badb2be800f9d2f05d7a28c25c55eee80"} Jul 06 17:46:47.205398 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.205357 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7jgm5" podStartSLOduration=374.201495791 podStartE2EDuration="6m15.205344114s" totalImagesPullingTime="1.003848323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:46:47.204495568 +0000 UTC m=+374.914380126" watchObservedRunningTime="2026-07-06 17:46:47.205344114 +0000 UTC m=+374.915228665" Jul 06 17:46:47.340772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.340741 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:47.347993 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.347968 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c94bcc458-jpt4f"] Jul 06 17:46:47.348304 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.348292 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b57821-2421-489f-922b-d2095104f1a7" containerName="console" Jul 06 17:46:47.348342 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.348306 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b57821-2421-489f-922b-d2095104f1a7" containerName="console" Jul 06 17:46:47.348375 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.348354 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b57821-2421-489f-922b-d2095104f1a7" containerName="console" Jul 06 17:46:47.350426 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.350411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.353161 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.353141 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 17:46:47.353400 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.353381 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4hll9\"" Jul 06 17:46:47.353500 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.353436 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 17:46:47.353500 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.353459 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 17:46:47.353500 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.353479 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 17:46:47.353646 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.353589 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 17:46:47.358900 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.358877 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 17:46:47.367090 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.367071 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c94bcc458-jpt4f"] Jul 06 17:46:47.399176 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.399142 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:47.476191 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.476109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-telemeter-client-tls\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.476191 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.476147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-federate-client-tls\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.476191 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.476171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-secret-telemeter-client\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.476455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.476279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-metrics-client-ca\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.476455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.476314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6gq8\" (UniqueName: \"kubernetes.io/projected/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-kube-api-access-r6gq8\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.476455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.476346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.476455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.476397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-serving-certs-ca-bundle\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.476455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.476430 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.560883 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.560839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:47.576968 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.576936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.577122 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.576993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-serving-certs-ca-bundle\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.577122 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.577017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.577122 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.577059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-telemeter-client-tls\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.577280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.577120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-federate-client-tls\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.577280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.577161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-secret-telemeter-client\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.577280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.577213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-metrics-client-ca\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.577280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.577240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6gq8\" (UniqueName: \"kubernetes.io/projected/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-kube-api-access-r6gq8\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.578215 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.577962 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-serving-certs-ca-bundle\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.578215 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.578150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.578408 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.578340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-metrics-client-ca\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.579719 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.579691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-secret-telemeter-client\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.579859 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.579838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.579909 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.579853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-telemeter-client-tls\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.579909 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.579880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-federate-client-tls\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.585336 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.585319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6gq8\" (UniqueName: \"kubernetes.io/projected/d1f1b903-5e33-42f1-a576-1d9d9e5b1c23-kube-api-access-r6gq8\") pod \"telemeter-client-5c94bcc458-jpt4f\" (UID: \"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23\") " pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.660631 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.660605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" Jul 06 17:46:47.667682 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.667652 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:47.722176 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.722143 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:47.795430 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:47.795407 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c94bcc458-jpt4f"] Jul 06 17:46:47.795887 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:46:47.795864 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f1b903_5e33_42f1_a576_1d9d9e5b1c23.slice/crio-ad4b0b92ee143819fb9727c3e5b5211d0bf174392040163bf74b2fec8729b859 WatchSource:0}: Error finding container ad4b0b92ee143819fb9727c3e5b5211d0bf174392040163bf74b2fec8729b859: Status 404 returned error can't find the container with id ad4b0b92ee143819fb9727c3e5b5211d0bf174392040163bf74b2fec8729b859 Jul 06 17:46:48.196123 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:48.196087 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" event={"ID":"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23","Type":"ContainerStarted","Data":"ad4b0b92ee143819fb9727c3e5b5211d0bf174392040163bf74b2fec8729b859"} Jul 06 17:46:50.205428 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:50.205396 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" event={"ID":"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23","Type":"ContainerStarted","Data":"76f462ce4b509ac053af6d58229c79a78c1b5c57cae2cec81bdee99cae510a93"} Jul 06 17:46:50.205816 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:50.205459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" event={"ID":"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23","Type":"ContainerStarted","Data":"de4869ed039e405eef6eef427e10fad632aabe026929b5c791fe798272fadac0"} Jul 06 17:46:50.205816 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:50.205487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" event={"ID":"d1f1b903-5e33-42f1-a576-1d9d9e5b1c23","Type":"ContainerStarted","Data":"e2cd1a16b3d1c65f67d204505f5e256828331d80490a2ab48a33f0fa42b698fa"} Jul 06 17:46:50.226056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:50.226005 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c94bcc458-jpt4f" podStartSLOduration=1.028804188 podStartE2EDuration="3.225989463s" totalImagesPullingTime="2.197185275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:46:50.2245024 +0000 UTC m=+377.934386951" watchObservedRunningTime="2026-07-06 17:46:50.225989463 +0000 UTC m=+377.935874016" Jul 06 17:46:51.458608 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.458573 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6964bff7b9-xx9cf"] Jul 06 17:46:51.460857 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.460838 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.472726 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.472664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6964bff7b9-xx9cf"] Jul 06 17:46:51.512983 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.512952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-oauth-config\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.513131 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.512988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-oauth-serving-cert\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.513131 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.513112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-service-ca\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.513245 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.513169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-trusted-ca-bundle\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.513245 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.513218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-serving-cert\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.513361 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.513259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzrfv\" (UniqueName: \"kubernetes.io/projected/6c065358-f13a-4d92-8d04-b8efef78a373-kube-api-access-zzrfv\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.513361 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.513311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-console-config\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.514582 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.514534 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:51.567649 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.567617 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:51.613960 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.613928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-oauth-config\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.614071 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.613967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-oauth-serving-cert\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.614071 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.614025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-service-ca\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.614071 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.614048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-trusted-ca-bundle\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.614221 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.614093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-serving-cert\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.614221 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.614118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzrfv\" (UniqueName: \"kubernetes.io/projected/6c065358-f13a-4d92-8d04-b8efef78a373-kube-api-access-zzrfv\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.614221 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.614148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-console-config\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.614921 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.614895 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-service-ca\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.615027 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.614926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-oauth-serving-cert\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.615027 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.614900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-console-config\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.615131 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.615107 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-trusted-ca-bundle\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.616656 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.616622 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-oauth-config\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.616765 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.616716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-serving-cert\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.622311 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.622290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzrfv\" (UniqueName: \"kubernetes.io/projected/6c065358-f13a-4d92-8d04-b8efef78a373-kube-api-access-zzrfv\") pod \"console-6964bff7b9-xx9cf\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.662804 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.662757 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:51.713270 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.713197 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:51.770261 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.770230 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:46:51.899734 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:51.899711 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6964bff7b9-xx9cf"] Jul 06 17:46:51.902062 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:46:51.902036 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c065358_f13a_4d92_8d04_b8efef78a373.slice/crio-6df6d1c95753b1e497f84702491861eb6a51d3652a10f9053d3c73ca44d334f1 WatchSource:0}: Error finding container 6df6d1c95753b1e497f84702491861eb6a51d3652a10f9053d3c73ca44d334f1: Status 404 returned error can't find the container with id 6df6d1c95753b1e497f84702491861eb6a51d3652a10f9053d3c73ca44d334f1 Jul 06 17:46:52.215627 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:52.215590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6964bff7b9-xx9cf" event={"ID":"6c065358-f13a-4d92-8d04-b8efef78a373","Type":"ContainerStarted","Data":"ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e"} Jul 06 17:46:52.215819 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:52.215642 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6964bff7b9-xx9cf" event={"ID":"6c065358-f13a-4d92-8d04-b8efef78a373","Type":"ContainerStarted","Data":"6df6d1c95753b1e497f84702491861eb6a51d3652a10f9053d3c73ca44d334f1"} Jul 06 17:46:52.235465 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:52.235398 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6964bff7b9-xx9cf" podStartSLOduration=1.235378546 podStartE2EDuration="1.235378546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:46:52.235076194 +0000 UTC m=+379.944960747" watchObservedRunningTime="2026-07-06 17:46:52.235378546 +0000 UTC m=+379.945263098" Jul 06 17:46:52.259296 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:52.259263 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:52.312367 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:52.312338 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:54.656094 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:54.656059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:54.710948 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:54.710912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:57.522853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:57.522821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:57.581568 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:46:57.581512 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:00.508825 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.508785 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6964bff7b9-xx9cf"] Jul 06 17:47:00.539175 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.539142 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58c56f86b-tf72t"] Jul 06 17:47:00.541636 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.541620 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.550349 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.550320 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c56f86b-tf72t"] Jul 06 17:47:00.699623 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.699587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-oauth-serving-cert\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.699768 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.699657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-serving-cert\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.699768 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.699686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4qr9\" (UniqueName: \"kubernetes.io/projected/17676285-7269-4907-ad29-4b8af045fe38-kube-api-access-h4qr9\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.699768 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.699723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-oauth-config\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.699768 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.699737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-service-ca\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.699918 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.699794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-console-config\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.699918 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.699824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-trusted-ca-bundle\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.800272 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.800186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-oauth-serving-cert\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.800272 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.800264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-serving-cert\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.800490 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.800291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4qr9\" (UniqueName: \"kubernetes.io/projected/17676285-7269-4907-ad29-4b8af045fe38-kube-api-access-h4qr9\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.800490 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.800345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-oauth-config\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.800490 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.800369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-service-ca\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.800490 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.800394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-console-config\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.801064 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.800731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-trusted-ca-bundle\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.801064 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.801031 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-console-config\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.801064 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.801031 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-oauth-serving-cert\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.801762 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.801705 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-trusted-ca-bundle\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.801965 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.801903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-service-ca\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.803130 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.803108 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-serving-cert\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.803438 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.803421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-oauth-config\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.809208 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.809175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4qr9\" (UniqueName: \"kubernetes.io/projected/17676285-7269-4907-ad29-4b8af045fe38-kube-api-access-h4qr9\") pod \"console-58c56f86b-tf72t\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.851451 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.851415 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:00.978779 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:00.978739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c56f86b-tf72t"] Jul 06 17:47:00.980826 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:47:00.980794 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17676285_7269_4907_ad29_4b8af045fe38.slice/crio-1636fa9a80f48ebc7e438f409d3b3ea0dca1e65213ece27db172c2aee173cac1 WatchSource:0}: Error finding container 1636fa9a80f48ebc7e438f409d3b3ea0dca1e65213ece27db172c2aee173cac1: Status 404 returned error can't find the container with id 1636fa9a80f48ebc7e438f409d3b3ea0dca1e65213ece27db172c2aee173cac1 Jul 06 17:47:01.255854 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:01.255811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c56f86b-tf72t" event={"ID":"17676285-7269-4907-ad29-4b8af045fe38","Type":"ContainerStarted","Data":"2d46761f99a6691f5ed2620a0f4235d88752e89249bb390ebd6ca08e408d1c91"} Jul 06 17:47:01.256026 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:01.255869 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c56f86b-tf72t" event={"ID":"17676285-7269-4907-ad29-4b8af045fe38","Type":"ContainerStarted","Data":"1636fa9a80f48ebc7e438f409d3b3ea0dca1e65213ece27db172c2aee173cac1"} Jul 06 17:47:01.279508 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:01.277997 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58c56f86b-tf72t" podStartSLOduration=1.277979311 podStartE2EDuration="1.277979311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:47:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:47:01.274248026 +0000 UTC m=+388.984132580" watchObservedRunningTime="2026-07-06 17:47:01.277979311 +0000 UTC m=+388.987863864" Jul 06 17:47:01.771150 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:01.771109 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:47:09.394807 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:09.394767 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:09.495726 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:09.495687 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:10.851963 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:10.851926 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:10.852351 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:10.851992 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:10.856763 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:10.856741 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:11.299664 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:11.299634 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:47:11.343025 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:11.342997 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66968fffc-slqpq"] Jul 06 17:47:11.445737 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:11.445702 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:11.502807 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:11.502773 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:11.554537 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:11.554454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:18.839924 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:18.839884 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:18.889771 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:18.889741 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:19.626328 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:19.626285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:24.662367 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:24.662333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:24.760370 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:24.760341 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:25.528826 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.528768 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6964bff7b9-xx9cf" podUID="6c065358-f13a-4d92-8d04-b8efef78a373" containerName="console" containerID="cri-o://ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e" gracePeriod=15 Jul 06 17:47:25.771750 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.771727 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:47:25.819702 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.819632 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-trusted-ca-bundle\") pod \"6c065358-f13a-4d92-8d04-b8efef78a373\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " Jul 06 17:47:25.819702 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.819680 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-oauth-serving-cert\") pod \"6c065358-f13a-4d92-8d04-b8efef78a373\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " Jul 06 17:47:25.819887 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.819708 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzrfv\" (UniqueName: \"kubernetes.io/projected/6c065358-f13a-4d92-8d04-b8efef78a373-kube-api-access-zzrfv\") pod \"6c065358-f13a-4d92-8d04-b8efef78a373\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " Jul 06 17:47:25.819887 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.819732 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-console-config\") pod \"6c065358-f13a-4d92-8d04-b8efef78a373\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " Jul 06 17:47:25.819887 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.819771 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-serving-cert\") pod \"6c065358-f13a-4d92-8d04-b8efef78a373\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " Jul 06 17:47:25.819887 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.819805 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-oauth-config\") pod \"6c065358-f13a-4d92-8d04-b8efef78a373\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " Jul 06 17:47:25.819887 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.819831 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-service-ca\") pod \"6c065358-f13a-4d92-8d04-b8efef78a373\" (UID: \"6c065358-f13a-4d92-8d04-b8efef78a373\") " Jul 06 17:47:25.820131 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.820100 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6c065358-f13a-4d92-8d04-b8efef78a373" (UID: "6c065358-f13a-4d92-8d04-b8efef78a373"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:47:25.820188 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.820121 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6c065358-f13a-4d92-8d04-b8efef78a373" (UID: "6c065358-f13a-4d92-8d04-b8efef78a373"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:47:25.820353 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.820321 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-service-ca" (OuterVolumeSpecName: "service-ca") pod "6c065358-f13a-4d92-8d04-b8efef78a373" (UID: "6c065358-f13a-4d92-8d04-b8efef78a373"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:47:25.820447 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.820388 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-console-config" (OuterVolumeSpecName: "console-config") pod "6c065358-f13a-4d92-8d04-b8efef78a373" (UID: "6c065358-f13a-4d92-8d04-b8efef78a373"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:47:25.821967 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.821946 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c065358-f13a-4d92-8d04-b8efef78a373-kube-api-access-zzrfv" (OuterVolumeSpecName: "kube-api-access-zzrfv") pod "6c065358-f13a-4d92-8d04-b8efef78a373" (UID: "6c065358-f13a-4d92-8d04-b8efef78a373"). InnerVolumeSpecName "kube-api-access-zzrfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:47:25.822039 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.821988 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6c065358-f13a-4d92-8d04-b8efef78a373" (UID: "6c065358-f13a-4d92-8d04-b8efef78a373"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:47:25.822039 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.822021 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6c065358-f13a-4d92-8d04-b8efef78a373" (UID: "6c065358-f13a-4d92-8d04-b8efef78a373"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:47:25.920450 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.920421 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-trusted-ca-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:25.920450 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.920446 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-oauth-serving-cert\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:25.920450 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.920455 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzrfv\" (UniqueName: \"kubernetes.io/projected/6c065358-f13a-4d92-8d04-b8efef78a373-kube-api-access-zzrfv\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:25.920678 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.920465 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-console-config\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:25.920678 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.920473 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-serving-cert\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:25.920678 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.920482 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c065358-f13a-4d92-8d04-b8efef78a373-console-oauth-config\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:25.920678 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:25.920490 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c065358-f13a-4d92-8d04-b8efef78a373-service-ca\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:26.362569 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.362512 2577 generic.go:356] "Generic (PLEG): container finished" podID="6c065358-f13a-4d92-8d04-b8efef78a373" containerID="ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e" exitCode=0 Jul 06 17:47:26.362766 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.362581 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6964bff7b9-xx9cf" Jul 06 17:47:26.362766 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.362595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6964bff7b9-xx9cf" event={"ID":"6c065358-f13a-4d92-8d04-b8efef78a373","Type":"ContainerDied","Data":"ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e"} Jul 06 17:47:26.362766 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.362648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6964bff7b9-xx9cf" event={"ID":"6c065358-f13a-4d92-8d04-b8efef78a373","Type":"ContainerDied","Data":"6df6d1c95753b1e497f84702491861eb6a51d3652a10f9053d3c73ca44d334f1"} Jul 06 17:47:26.362766 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.362669 2577 scope.go:117] "RemoveContainer" containerID="ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e" Jul 06 17:47:26.371520 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.371504 2577 scope.go:117] "RemoveContainer" containerID="ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e" Jul 06 17:47:26.371819 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:47:26.371800 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e\": container with ID starting with ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e not found: ID does not exist" containerID="ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e" Jul 06 17:47:26.371869 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.371828 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e"} err="failed to get container status \"ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e\": rpc error: code = NotFound desc = could not find container \"ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e\": container with ID starting with ce23dd8eb7f614a48ecafe5c00e68a8302d1dd9c3a66bcd2a3af87f03d6e845e not found: ID does not exist" Jul 06 17:47:26.383845 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.383821 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6964bff7b9-xx9cf"] Jul 06 17:47:26.387683 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.387660 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6964bff7b9-xx9cf"] Jul 06 17:47:26.810843 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:26.810809 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c065358-f13a-4d92-8d04-b8efef78a373" path="/var/lib/kubelet/pods/6c065358-f13a-4d92-8d04-b8efef78a373/volumes" Jul 06 17:47:36.364184 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.364119 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66968fffc-slqpq" podUID="802290e6-9893-4b72-b991-9543581ebea2" containerName="console" containerID="cri-o://d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4" gracePeriod=15 Jul 06 17:47:36.605536 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.605511 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:47:36.716330 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716302 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-oauth-serving-cert\") pod \"802290e6-9893-4b72-b991-9543581ebea2\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " Jul 06 17:47:36.716517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716366 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4nn6\" (UniqueName: \"kubernetes.io/projected/802290e6-9893-4b72-b991-9543581ebea2-kube-api-access-q4nn6\") pod \"802290e6-9893-4b72-b991-9543581ebea2\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " Jul 06 17:47:36.716517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716391 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-oauth-config\") pod \"802290e6-9893-4b72-b991-9543581ebea2\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " Jul 06 17:47:36.716517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716415 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-serving-cert\") pod \"802290e6-9893-4b72-b991-9543581ebea2\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " Jul 06 17:47:36.716517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716431 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-service-ca\") pod \"802290e6-9893-4b72-b991-9543581ebea2\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " Jul 06 17:47:36.716517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716456 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-trusted-ca-bundle\") pod \"802290e6-9893-4b72-b991-9543581ebea2\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " Jul 06 17:47:36.716517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716480 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-console-config\") pod \"802290e6-9893-4b72-b991-9543581ebea2\" (UID: \"802290e6-9893-4b72-b991-9543581ebea2\") " Jul 06 17:47:36.716881 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716752 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "802290e6-9893-4b72-b991-9543581ebea2" (UID: "802290e6-9893-4b72-b991-9543581ebea2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:47:36.716943 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716871 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-service-ca" (OuterVolumeSpecName: "service-ca") pod "802290e6-9893-4b72-b991-9543581ebea2" (UID: "802290e6-9893-4b72-b991-9543581ebea2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:47:36.717001 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.716961 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-console-config" (OuterVolumeSpecName: "console-config") pod "802290e6-9893-4b72-b991-9543581ebea2" (UID: "802290e6-9893-4b72-b991-9543581ebea2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:47:36.717083 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.717059 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "802290e6-9893-4b72-b991-9543581ebea2" (UID: "802290e6-9893-4b72-b991-9543581ebea2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:47:36.718686 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.718667 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "802290e6-9893-4b72-b991-9543581ebea2" (UID: "802290e6-9893-4b72-b991-9543581ebea2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:47:36.718833 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.718815 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/802290e6-9893-4b72-b991-9543581ebea2-kube-api-access-q4nn6" (OuterVolumeSpecName: "kube-api-access-q4nn6") pod "802290e6-9893-4b72-b991-9543581ebea2" (UID: "802290e6-9893-4b72-b991-9543581ebea2"). InnerVolumeSpecName "kube-api-access-q4nn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:47:36.718875 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.718820 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "802290e6-9893-4b72-b991-9543581ebea2" (UID: "802290e6-9893-4b72-b991-9543581ebea2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:47:36.817693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.817667 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-trusted-ca-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:36.817693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.817690 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-console-config\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:36.817693 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.817699 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-oauth-serving-cert\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:36.817911 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.817708 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4nn6\" (UniqueName: \"kubernetes.io/projected/802290e6-9893-4b72-b991-9543581ebea2-kube-api-access-q4nn6\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:36.817911 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.817720 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-oauth-config\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:36.817911 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.817732 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/802290e6-9893-4b72-b991-9543581ebea2-console-serving-cert\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:36.817911 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:36.817745 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/802290e6-9893-4b72-b991-9543581ebea2-service-ca\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:47:37.409891 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:37.409854 2577 generic.go:356] "Generic (PLEG): container finished" podID="802290e6-9893-4b72-b991-9543581ebea2" containerID="d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4" exitCode=0 Jul 06 17:47:37.409891 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:37.409897 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66968fffc-slqpq" Jul 06 17:47:37.410340 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:37.409931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66968fffc-slqpq" event={"ID":"802290e6-9893-4b72-b991-9543581ebea2","Type":"ContainerDied","Data":"d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4"} Jul 06 17:47:37.410340 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:37.409978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66968fffc-slqpq" event={"ID":"802290e6-9893-4b72-b991-9543581ebea2","Type":"ContainerDied","Data":"e8446ec89f2e205622baf07a629a7184cb26f6776b1d3d52a3eacdd14af69db3"} Jul 06 17:47:37.410340 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:37.409997 2577 scope.go:117] "RemoveContainer" containerID="d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4" Jul 06 17:47:37.418424 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:37.418405 2577 scope.go:117] "RemoveContainer" containerID="d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4" Jul 06 17:47:37.418735 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:47:37.418717 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4\": container with ID starting with d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4 not found: ID does not exist" containerID="d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4" Jul 06 17:47:37.418794 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:37.418745 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4"} err="failed to get container status \"d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4\": rpc error: code = NotFound desc = could not find container \"d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4\": container with ID starting with d68bd60b528475ad07c31cf8a42bbe229395a8ea2dde7f50d6fe92450fee62e4 not found: ID does not exist" Jul 06 17:47:37.427702 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:37.427676 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66968fffc-slqpq"] Jul 06 17:47:37.432435 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:37.432413 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66968fffc-slqpq"] Jul 06 17:47:38.811561 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:47:38.811522 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="802290e6-9893-4b72-b991-9543581ebea2" path="/var/lib/kubelet/pods/802290e6-9893-4b72-b991-9543581ebea2/volumes" Jul 06 17:48:16.293211 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.293169 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:16.385902 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.385861 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:16.824064 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.824034 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f"] Jul 06 17:48:16.824380 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.824367 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="802290e6-9893-4b72-b991-9543581ebea2" containerName="console" Jul 06 17:48:16.824423 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.824383 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="802290e6-9893-4b72-b991-9543581ebea2" containerName="console" Jul 06 17:48:16.824423 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.824403 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c065358-f13a-4d92-8d04-b8efef78a373" containerName="console" Jul 06 17:48:16.824423 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.824408 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c065358-f13a-4d92-8d04-b8efef78a373" containerName="console" Jul 06 17:48:16.824515 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.824464 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="802290e6-9893-4b72-b991-9543581ebea2" containerName="console" Jul 06 17:48:16.824515 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.824472 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c065358-f13a-4d92-8d04-b8efef78a373" containerName="console" Jul 06 17:48:16.828060 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.828045 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:16.831222 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.831194 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 17:48:16.832698 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.832681 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gtsrj\"" Jul 06 17:48:16.832759 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.832700 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 17:48:16.836731 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.836708 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f"] Jul 06 17:48:16.842455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.842433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:16.842591 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.842514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nn7m\" (UniqueName: \"kubernetes.io/projected/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-kube-api-access-6nn7m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:16.842837 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.842810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:16.944286 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.944257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:16.944464 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.944306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nn7m\" (UniqueName: \"kubernetes.io/projected/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-kube-api-access-6nn7m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:16.944464 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.944335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:16.944730 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.944714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:16.944823 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.944751 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:16.953191 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:16.953158 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nn7m\" (UniqueName: \"kubernetes.io/projected/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-kube-api-access-6nn7m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:17.137734 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:17.137645 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:17.263678 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:17.263656 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f"] Jul 06 17:48:17.265978 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:48:17.265947 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2f2256_54c0_4ac1_8c94_4b36eeea5d96.slice/crio-15b42bdfdee17b01e7990c1d7870ed9d304e731d6c9fb646f1b0d24868b73d00 WatchSource:0}: Error finding container 15b42bdfdee17b01e7990c1d7870ed9d304e731d6c9fb646f1b0d24868b73d00: Status 404 returned error can't find the container with id 15b42bdfdee17b01e7990c1d7870ed9d304e731d6c9fb646f1b0d24868b73d00 Jul 06 17:48:17.574375 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:17.574338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" event={"ID":"de2f2256-54c0-4ac1-8c94-4b36eeea5d96","Type":"ContainerStarted","Data":"15b42bdfdee17b01e7990c1d7870ed9d304e731d6c9fb646f1b0d24868b73d00"} Jul 06 17:48:25.609810 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:25.609773 2577 generic.go:356] "Generic (PLEG): container finished" podID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerID="3e31ea16196181466c2dd0f6a8cfe489b60626a343777d261b5fed0d81b8e8c9" exitCode=0 Jul 06 17:48:25.610235 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:25.609825 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" event={"ID":"de2f2256-54c0-4ac1-8c94-4b36eeea5d96","Type":"ContainerDied","Data":"3e31ea16196181466c2dd0f6a8cfe489b60626a343777d261b5fed0d81b8e8c9"} Jul 06 17:48:28.625958 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:28.625918 2577 generic.go:356] "Generic (PLEG): container finished" podID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerID="b84c07985cf77214046814a87d1b7fd376e26e8d7f0abec533caa8a66c1b0b98" exitCode=0 Jul 06 17:48:28.626360 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:28.626004 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" event={"ID":"de2f2256-54c0-4ac1-8c94-4b36eeea5d96","Type":"ContainerDied","Data":"b84c07985cf77214046814a87d1b7fd376e26e8d7f0abec533caa8a66c1b0b98"} Jul 06 17:48:34.657476 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:34.657385 2577 generic.go:356] "Generic (PLEG): container finished" podID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerID="409bc983598d78118b7a482779daa20128e9994a9170ba59c7fb181892c33fd5" exitCode=0 Jul 06 17:48:34.657476 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:34.657431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" event={"ID":"de2f2256-54c0-4ac1-8c94-4b36eeea5d96","Type":"ContainerDied","Data":"409bc983598d78118b7a482779daa20128e9994a9170ba59c7fb181892c33fd5"} Jul 06 17:48:35.786006 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:35.785984 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:35.925411 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:35.925322 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nn7m\" (UniqueName: \"kubernetes.io/projected/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-kube-api-access-6nn7m\") pod \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " Jul 06 17:48:35.925411 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:35.925373 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-util\") pod \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " Jul 06 17:48:35.925411 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:35.925410 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-bundle\") pod \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\" (UID: \"de2f2256-54c0-4ac1-8c94-4b36eeea5d96\") " Jul 06 17:48:35.926270 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:35.926239 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-bundle" (OuterVolumeSpecName: "bundle") pod "de2f2256-54c0-4ac1-8c94-4b36eeea5d96" (UID: "de2f2256-54c0-4ac1-8c94-4b36eeea5d96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:48:35.927669 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:35.927647 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-kube-api-access-6nn7m" (OuterVolumeSpecName: "kube-api-access-6nn7m") pod "de2f2256-54c0-4ac1-8c94-4b36eeea5d96" (UID: "de2f2256-54c0-4ac1-8c94-4b36eeea5d96"). InnerVolumeSpecName "kube-api-access-6nn7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:48:35.929839 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:35.929820 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-util" (OuterVolumeSpecName: "util") pod "de2f2256-54c0-4ac1-8c94-4b36eeea5d96" (UID: "de2f2256-54c0-4ac1-8c94-4b36eeea5d96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:48:36.026625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:36.026596 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:48:36.026625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:36.026622 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nn7m\" (UniqueName: \"kubernetes.io/projected/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-kube-api-access-6nn7m\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:48:36.026625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:36.026632 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de2f2256-54c0-4ac1-8c94-4b36eeea5d96-util\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:48:36.666897 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:36.666865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" event={"ID":"de2f2256-54c0-4ac1-8c94-4b36eeea5d96","Type":"ContainerDied","Data":"15b42bdfdee17b01e7990c1d7870ed9d304e731d6c9fb646f1b0d24868b73d00"} Jul 06 17:48:36.667068 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:36.666913 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15b42bdfdee17b01e7990c1d7870ed9d304e731d6c9fb646f1b0d24868b73d00" Jul 06 17:48:36.667068 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:36.666874 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c847f" Jul 06 17:48:37.794092 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:37.794061 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:38.566145 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:38.566104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:39.769428 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.769395 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp"] Jul 06 17:48:39.769923 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.769902 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerName="extract" Jul 06 17:48:39.769969 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.769928 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerName="extract" Jul 06 17:48:39.769969 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.769953 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerName="util" Jul 06 17:48:39.769969 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.769963 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerName="util" Jul 06 17:48:39.770060 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.769974 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerName="pull" Jul 06 17:48:39.770060 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.769982 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerName="pull" Jul 06 17:48:39.770122 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.770113 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="de2f2256-54c0-4ac1-8c94-4b36eeea5d96" containerName="extract" Jul 06 17:48:39.805853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.805827 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp"] Jul 06 17:48:39.805991 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.805924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" Jul 06 17:48:39.808795 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.808763 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zrljp\"" Jul 06 17:48:39.808795 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.808768 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:48:39.808980 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.808950 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 17:48:39.960689 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.960658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr6sk\" (UniqueName: \"kubernetes.io/projected/80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c-kube-api-access-nr6sk\") pod \"cert-manager-operator-controller-manager-55c444bf86-fblkp\" (UID: \"80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" Jul 06 17:48:39.960847 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:39.960706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fblkp\" (UID: \"80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" Jul 06 17:48:40.061959 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:40.061875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fblkp\" (UID: \"80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" Jul 06 17:48:40.061959 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:40.061943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr6sk\" (UniqueName: \"kubernetes.io/projected/80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c-kube-api-access-nr6sk\") pod \"cert-manager-operator-controller-manager-55c444bf86-fblkp\" (UID: \"80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" Jul 06 17:48:40.062257 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:40.062238 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fblkp\" (UID: \"80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" Jul 06 17:48:40.070178 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:40.070152 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr6sk\" (UniqueName: \"kubernetes.io/projected/80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c-kube-api-access-nr6sk\") pod \"cert-manager-operator-controller-manager-55c444bf86-fblkp\" (UID: \"80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" Jul 06 17:48:40.115267 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:40.115240 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" Jul 06 17:48:40.268062 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:40.268032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp"] Jul 06 17:48:40.271617 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:48:40.271590 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80cfbbd8_5f32_400f_8f49_8a5a2cb1fd5c.slice/crio-3084e25797e1402a936033b952d2c9b32fdbf2633ec2b815688950fabb150d30 WatchSource:0}: Error finding container 3084e25797e1402a936033b952d2c9b32fdbf2633ec2b815688950fabb150d30: Status 404 returned error can't find the container with id 3084e25797e1402a936033b952d2c9b32fdbf2633ec2b815688950fabb150d30 Jul 06 17:48:40.686222 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:40.686175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" event={"ID":"80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c","Type":"ContainerStarted","Data":"3084e25797e1402a936033b952d2c9b32fdbf2633ec2b815688950fabb150d30"} Jul 06 17:48:41.399934 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:41.399902 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:41.500312 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:41.500273 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:43.346100 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.346064 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:43.451781 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.451745 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:43.540366 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.540326 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jv8zz"] Jul 06 17:48:43.542690 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.542662 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:48:43.545504 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.545486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 17:48:43.545765 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.545750 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 17:48:43.547218 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.547201 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-llqtx\"" Jul 06 17:48:43.552232 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.552210 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jv8zz"] Jul 06 17:48:43.694295 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.694258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zf26\" (UniqueName: \"kubernetes.io/projected/b6947b92-4eae-4ced-837f-7060f747f302-kube-api-access-6zf26\") pod \"cert-manager-webhook-6486ffd997-jv8zz\" (UID: \"b6947b92-4eae-4ced-837f-7060f747f302\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:48:43.694471 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.694321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6947b92-4eae-4ced-837f-7060f747f302-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jv8zz\" (UID: \"b6947b92-4eae-4ced-837f-7060f747f302\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:48:43.704576 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.704530 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" event={"ID":"80cfbbd8-5f32-400f-8f49-8a5a2cb1fd5c","Type":"ContainerStarted","Data":"7f72f27b5ab03ffb15883c9628272714065e1d6c1be14bda7b76a7a4c9c5db53"} Jul 06 17:48:43.724033 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.723986 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fblkp" podStartSLOduration=2.2377795 podStartE2EDuration="4.723970484s" totalImagesPullingTime="2.486190984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:48:43.722299737 +0000 UTC m=+491.432184290" watchObservedRunningTime="2026-07-06 17:48:43.723970484 +0000 UTC m=+491.433855036" Jul 06 17:48:43.794803 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.794769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6947b92-4eae-4ced-837f-7060f747f302-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jv8zz\" (UID: \"b6947b92-4eae-4ced-837f-7060f747f302\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:48:43.794962 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.794938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zf26\" (UniqueName: \"kubernetes.io/projected/b6947b92-4eae-4ced-837f-7060f747f302-kube-api-access-6zf26\") pod \"cert-manager-webhook-6486ffd997-jv8zz\" (UID: \"b6947b92-4eae-4ced-837f-7060f747f302\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:48:43.803314 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.803279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6947b92-4eae-4ced-837f-7060f747f302-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jv8zz\" (UID: \"b6947b92-4eae-4ced-837f-7060f747f302\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:48:43.803428 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.803399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zf26\" (UniqueName: \"kubernetes.io/projected/b6947b92-4eae-4ced-837f-7060f747f302-kube-api-access-6zf26\") pod \"cert-manager-webhook-6486ffd997-jv8zz\" (UID: \"b6947b92-4eae-4ced-837f-7060f747f302\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:48:43.861849 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.861829 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:48:43.989456 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:43.989432 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jv8zz"] Jul 06 17:48:43.991775 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:48:43.991744 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6947b92_4eae_4ced_837f_7060f747f302.slice/crio-2bd25abdddb15854288572e51fd147ec5dbbfc67e10ba05c88ac1999e1ac80ec WatchSource:0}: Error finding container 2bd25abdddb15854288572e51fd147ec5dbbfc67e10ba05c88ac1999e1ac80ec: Status 404 returned error can't find the container with id 2bd25abdddb15854288572e51fd147ec5dbbfc67e10ba05c88ac1999e1ac80ec Jul 06 17:48:44.109725 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.109693 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:44.215611 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.215568 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:44.317589 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.317464 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:44.413083 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.413052 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8"] Jul 06 17:48:44.416219 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.416200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.419185 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.419169 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 17:48:44.419294 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.419209 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 17:48:44.420661 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.420644 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gtsrj\"" Jul 06 17:48:44.425317 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.425296 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8"] Jul 06 17:48:44.501497 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.501467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.501684 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.501502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.501684 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.501524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hqz4\" (UniqueName: \"kubernetes.io/projected/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-kube-api-access-7hqz4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.602894 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.602800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.602894 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.602842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.602894 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.602867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hqz4\" (UniqueName: \"kubernetes.io/projected/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-kube-api-access-7hqz4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.603202 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.603183 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.603266 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.603250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.614793 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.614763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hqz4\" (UniqueName: \"kubernetes.io/projected/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-kube-api-access-7hqz4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.709892 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.709856 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" event={"ID":"b6947b92-4eae-4ced-837f-7060f747f302","Type":"ContainerStarted","Data":"2bd25abdddb15854288572e51fd147ec5dbbfc67e10ba05c88ac1999e1ac80ec"} Jul 06 17:48:44.727289 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.727264 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:44.850762 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:44.850738 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8"] Jul 06 17:48:44.852973 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:48:44.852906 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed162e4_e6bf_4fa2_b2f2_879f6779cdcb.slice/crio-11761ebd30990eb84f99b532f6d8f5245bf917ce66c0fea9313ea08d759f7ce9 WatchSource:0}: Error finding container 11761ebd30990eb84f99b532f6d8f5245bf917ce66c0fea9313ea08d759f7ce9: Status 404 returned error can't find the container with id 11761ebd30990eb84f99b532f6d8f5245bf917ce66c0fea9313ea08d759f7ce9 Jul 06 17:48:45.716510 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:45.716476 2577 generic.go:356] "Generic (PLEG): container finished" podID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerID="bc30bf85d331d7ef95f9ec4978b93519a03777c4bd8f71809b9f8b1a57785639" exitCode=0 Jul 06 17:48:45.716918 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:45.716583 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" event={"ID":"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb","Type":"ContainerDied","Data":"bc30bf85d331d7ef95f9ec4978b93519a03777c4bd8f71809b9f8b1a57785639"} Jul 06 17:48:45.716918 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:45.716645 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" event={"ID":"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb","Type":"ContainerStarted","Data":"11761ebd30990eb84f99b532f6d8f5245bf917ce66c0fea9313ea08d759f7ce9"} Jul 06 17:48:45.743364 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:45.743335 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:45.974382 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:45.974293 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:47.728148 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:47.728053 2577 generic.go:356] "Generic (PLEG): container finished" podID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerID="a4bd6ea3a0a13140ea75f8093f9737b0291f081b731e0457db376d28e7954475" exitCode=0 Jul 06 17:48:47.728517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:47.728141 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" event={"ID":"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb","Type":"ContainerDied","Data":"a4bd6ea3a0a13140ea75f8093f9737b0291f081b731e0457db376d28e7954475"} Jul 06 17:48:48.190211 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:48.190182 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:48.289958 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:48.289921 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:48.734884 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:48.734851 2577 generic.go:356] "Generic (PLEG): container finished" podID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerID="d41e911b38c716561f5da67ae80b3e66505c4a2713a083ed42111a7524c25035" exitCode=0 Jul 06 17:48:48.735263 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:48.734931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" event={"ID":"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb","Type":"ContainerDied","Data":"d41e911b38c716561f5da67ae80b3e66505c4a2713a083ed42111a7524c25035"} Jul 06 17:48:49.872630 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:49.872608 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:50.051455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.051373 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-bundle\") pod \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " Jul 06 17:48:50.051455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.051417 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-util\") pod \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " Jul 06 17:48:50.051455 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.051446 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hqz4\" (UniqueName: \"kubernetes.io/projected/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-kube-api-access-7hqz4\") pod \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\" (UID: \"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb\") " Jul 06 17:48:50.051835 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.051812 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-bundle" (OuterVolumeSpecName: "bundle") pod "4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" (UID: "4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:48:50.053505 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.053482 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-kube-api-access-7hqz4" (OuterVolumeSpecName: "kube-api-access-7hqz4") pod "4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" (UID: "4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb"). InnerVolumeSpecName "kube-api-access-7hqz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:48:50.056956 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.056929 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-util" (OuterVolumeSpecName: "util") pod "4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" (UID: "4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:48:50.152708 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.152682 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:48:50.152708 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.152705 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-util\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:48:50.152708 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.152713 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hqz4\" (UniqueName: \"kubernetes.io/projected/4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb-kube-api-access-7hqz4\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:48:50.323663 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.323590 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc"] Jul 06 17:48:50.323938 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.323926 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerName="extract" Jul 06 17:48:50.323995 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.323940 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerName="extract" Jul 06 17:48:50.323995 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.323951 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerName="util" Jul 06 17:48:50.323995 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.323957 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerName="util" Jul 06 17:48:50.323995 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.323964 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerName="pull" Jul 06 17:48:50.323995 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.323969 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerName="pull" Jul 06 17:48:50.324162 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.324055 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb" containerName="extract" Jul 06 17:48:50.326130 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.326112 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" Jul 06 17:48:50.329019 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.328998 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zp27x\"" Jul 06 17:48:50.335170 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.335151 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc"] Jul 06 17:48:50.456049 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.456010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6gxh\" (UniqueName: \"kubernetes.io/projected/8fe96d64-3fb2-4052-b192-6a7dde02fc3e-kube-api-access-t6gxh\") pod \"cert-manager-cainjector-559cdd8c87-9jbzc\" (UID: \"8fe96d64-3fb2-4052-b192-6a7dde02fc3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" Jul 06 17:48:50.456229 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.456057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fe96d64-3fb2-4052-b192-6a7dde02fc3e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jbzc\" (UID: \"8fe96d64-3fb2-4052-b192-6a7dde02fc3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" Jul 06 17:48:50.556991 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.556896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6gxh\" (UniqueName: \"kubernetes.io/projected/8fe96d64-3fb2-4052-b192-6a7dde02fc3e-kube-api-access-t6gxh\") pod \"cert-manager-cainjector-559cdd8c87-9jbzc\" (UID: \"8fe96d64-3fb2-4052-b192-6a7dde02fc3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" Jul 06 17:48:50.557171 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.557016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fe96d64-3fb2-4052-b192-6a7dde02fc3e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jbzc\" (UID: \"8fe96d64-3fb2-4052-b192-6a7dde02fc3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" Jul 06 17:48:50.565274 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.565254 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fe96d64-3fb2-4052-b192-6a7dde02fc3e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jbzc\" (UID: \"8fe96d64-3fb2-4052-b192-6a7dde02fc3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" Jul 06 17:48:50.565480 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.565458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6gxh\" (UniqueName: \"kubernetes.io/projected/8fe96d64-3fb2-4052-b192-6a7dde02fc3e-kube-api-access-t6gxh\") pod \"cert-manager-cainjector-559cdd8c87-9jbzc\" (UID: \"8fe96d64-3fb2-4052-b192-6a7dde02fc3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" Jul 06 17:48:50.635981 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.635897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" Jul 06 17:48:50.748520 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.748487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" event={"ID":"4ed162e4-e6bf-4fa2-b2f2-879f6779cdcb","Type":"ContainerDied","Data":"11761ebd30990eb84f99b532f6d8f5245bf917ce66c0fea9313ea08d759f7ce9"} Jul 06 17:48:50.748706 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.748523 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frfpg8" Jul 06 17:48:50.748706 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.748570 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11761ebd30990eb84f99b532f6d8f5245bf917ce66c0fea9313ea08d759f7ce9" Jul 06 17:48:50.785104 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:50.785067 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc"] Jul 06 17:48:50.788489 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:48:50.788451 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fe96d64_3fb2_4052_b192_6a7dde02fc3e.slice/crio-1e2a3a8ae60529360a0bc2fc6d8271806a01ce724a8b4a634924d48a25cc1a60 WatchSource:0}: Error finding container 1e2a3a8ae60529360a0bc2fc6d8271806a01ce724a8b4a634924d48a25cc1a60: Status 404 returned error can't find the container with id 1e2a3a8ae60529360a0bc2fc6d8271806a01ce724a8b4a634924d48a25cc1a60 Jul 06 17:48:51.755157 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:51.755115 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" event={"ID":"8fe96d64-3fb2-4052-b192-6a7dde02fc3e","Type":"ContainerStarted","Data":"1e2a3a8ae60529360a0bc2fc6d8271806a01ce724a8b4a634924d48a25cc1a60"} Jul 06 17:48:53.360674 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:53.360563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:54.206976 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:54.206912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:54.304715 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:54.304666 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:54.542502 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:54.542404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:54.619425 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:54.619387 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:54.772612 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:54.772580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" event={"ID":"b6947b92-4eae-4ced-837f-7060f747f302","Type":"ContainerStarted","Data":"2b2b9e105ba830730b7ef4c2bdb37ae35b4f05682a435499385be0a96c4ae317"} Jul 06 17:48:54.772776 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:54.772683 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:48:54.774127 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:54.774102 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" event={"ID":"8fe96d64-3fb2-4052-b192-6a7dde02fc3e","Type":"ContainerStarted","Data":"de29bb1d315704b3e2c7c3dc138a4e3eb4bf5394b56bf2df30331e935d1d8041"} Jul 06 17:48:54.791367 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:54.791315 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" podStartSLOduration=2.018208543 podStartE2EDuration="11.791296974s" totalImagesPullingTime="9.773088431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:48:54.788485771 +0000 UTC m=+502.498370322" watchObservedRunningTime="2026-07-06 17:48:54.791296974 +0000 UTC m=+502.501181531" Jul 06 17:48:54.808370 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:48:54.808279 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" podStartSLOduration=1.8377396080000001 podStartE2EDuration="4.808260937s" totalImagesPullingTime="2.970521329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:48:54.805808097 +0000 UTC m=+502.515692652" watchObservedRunningTime="2026-07-06 17:48:54.808260937 +0000 UTC m=+502.518145493" Jul 06 17:49:00.780618 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:00.780584 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jv8zz" Jul 06 17:49:13.490563 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:13.490511 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:13.595481 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:13.595447 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:15.269398 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:15.269342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:16.465765 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.465729 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8"] Jul 06 17:49:16.472170 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.472150 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.475581 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.475541 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 17:49:16.475699 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.475540 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gtsrj\"" Jul 06 17:49:16.475699 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.475615 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 17:49:16.476116 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.476090 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8"] Jul 06 17:49:16.576785 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.576757 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.576951 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.576821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.576951 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.576910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9wbz\" (UniqueName: \"kubernetes.io/projected/77454e35-e272-489c-b355-d5dc3caf71c4-kube-api-access-x9wbz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.677822 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.677772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.677999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.677851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.677999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.677888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9wbz\" (UniqueName: \"kubernetes.io/projected/77454e35-e272-489c-b355-d5dc3caf71c4-kube-api-access-x9wbz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.678243 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.678220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.678243 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.678235 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.686799 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.686775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9wbz\" (UniqueName: \"kubernetes.io/projected/77454e35-e272-489c-b355-d5dc3caf71c4-kube-api-access-x9wbz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.783517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.783413 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:16.912792 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:16.912767 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8"] Jul 06 17:49:16.914520 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:49:16.914491 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77454e35_e272_489c_b355_d5dc3caf71c4.slice/crio-5bfd5def5e115f8cf65d00e802cc4c5025b21648c5893c46a31f54da4ea5470e WatchSource:0}: Error finding container 5bfd5def5e115f8cf65d00e802cc4c5025b21648c5893c46a31f54da4ea5470e: Status 404 returned error can't find the container with id 5bfd5def5e115f8cf65d00e802cc4c5025b21648c5893c46a31f54da4ea5470e Jul 06 17:49:17.881602 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:17.881573 2577 generic.go:356] "Generic (PLEG): container finished" podID="77454e35-e272-489c-b355-d5dc3caf71c4" containerID="86be6eb0544190fcdfe48b7df0cadee8c0af9be284c71110150a5aa2d5493115" exitCode=0 Jul 06 17:49:17.882000 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:17.881696 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" event={"ID":"77454e35-e272-489c-b355-d5dc3caf71c4","Type":"ContainerDied","Data":"86be6eb0544190fcdfe48b7df0cadee8c0af9be284c71110150a5aa2d5493115"} Jul 06 17:49:17.882000 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:17.881740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" event={"ID":"77454e35-e272-489c-b355-d5dc3caf71c4","Type":"ContainerStarted","Data":"5bfd5def5e115f8cf65d00e802cc4c5025b21648c5893c46a31f54da4ea5470e"} Jul 06 17:49:18.888323 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:18.888242 2577 generic.go:356] "Generic (PLEG): container finished" podID="77454e35-e272-489c-b355-d5dc3caf71c4" containerID="ee8e0fece81cd5f1bb463047e66a208b90f6504a09f8f6770211c9831dd24307" exitCode=0 Jul 06 17:49:18.888715 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:18.888335 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" event={"ID":"77454e35-e272-489c-b355-d5dc3caf71c4","Type":"ContainerDied","Data":"ee8e0fece81cd5f1bb463047e66a208b90f6504a09f8f6770211c9831dd24307"} Jul 06 17:49:19.895324 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:19.895293 2577 generic.go:356] "Generic (PLEG): container finished" podID="77454e35-e272-489c-b355-d5dc3caf71c4" containerID="ab11282b5c8fe92d38c6f71bc1950544a0bee990c55b9a6ee620449945a4a4a6" exitCode=0 Jul 06 17:49:19.895738 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:19.895345 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" event={"ID":"77454e35-e272-489c-b355-d5dc3caf71c4","Type":"ContainerDied","Data":"ab11282b5c8fe92d38c6f71bc1950544a0bee990c55b9a6ee620449945a4a4a6"} Jul 06 17:49:21.027384 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.027349 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:21.114795 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.114755 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9wbz\" (UniqueName: \"kubernetes.io/projected/77454e35-e272-489c-b355-d5dc3caf71c4-kube-api-access-x9wbz\") pod \"77454e35-e272-489c-b355-d5dc3caf71c4\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " Jul 06 17:49:21.114979 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.114832 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-bundle\") pod \"77454e35-e272-489c-b355-d5dc3caf71c4\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " Jul 06 17:49:21.115026 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.115001 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-util\") pod \"77454e35-e272-489c-b355-d5dc3caf71c4\" (UID: \"77454e35-e272-489c-b355-d5dc3caf71c4\") " Jul 06 17:49:21.115540 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.115517 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-bundle" (OuterVolumeSpecName: "bundle") pod "77454e35-e272-489c-b355-d5dc3caf71c4" (UID: "77454e35-e272-489c-b355-d5dc3caf71c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:49:21.116934 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.116906 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77454e35-e272-489c-b355-d5dc3caf71c4-kube-api-access-x9wbz" (OuterVolumeSpecName: "kube-api-access-x9wbz") pod "77454e35-e272-489c-b355-d5dc3caf71c4" (UID: "77454e35-e272-489c-b355-d5dc3caf71c4"). InnerVolumeSpecName "kube-api-access-x9wbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:49:21.120842 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.120807 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-util" (OuterVolumeSpecName: "util") pod "77454e35-e272-489c-b355-d5dc3caf71c4" (UID: "77454e35-e272-489c-b355-d5dc3caf71c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:49:21.216756 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.216722 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:49:21.216756 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.216752 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77454e35-e272-489c-b355-d5dc3caf71c4-util\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:49:21.216756 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.216762 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9wbz\" (UniqueName: \"kubernetes.io/projected/77454e35-e272-489c-b355-d5dc3caf71c4-kube-api-access-x9wbz\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:49:21.906179 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.906149 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" Jul 06 17:49:21.906350 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.906153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b5m8" event={"ID":"77454e35-e272-489c-b355-d5dc3caf71c4","Type":"ContainerDied","Data":"5bfd5def5e115f8cf65d00e802cc4c5025b21648c5893c46a31f54da4ea5470e"} Jul 06 17:49:21.906350 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:21.906277 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bfd5def5e115f8cf65d00e802cc4c5025b21648c5893c46a31f54da4ea5470e" Jul 06 17:49:27.223019 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:27.222931 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:27.320843 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:27.320809 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:27.828084 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:27.828049 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.018036 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.018001 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.121754 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.121671 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.153132 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.153088 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l"] Jul 06 17:49:28.153517 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.153498 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77454e35-e272-489c-b355-d5dc3caf71c4" containerName="extract" Jul 06 17:49:28.153640 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.153519 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77454e35-e272-489c-b355-d5dc3caf71c4" containerName="extract" Jul 06 17:49:28.153640 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.153539 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77454e35-e272-489c-b355-d5dc3caf71c4" containerName="util" Jul 06 17:49:28.153640 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.153564 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77454e35-e272-489c-b355-d5dc3caf71c4" containerName="util" Jul 06 17:49:28.153640 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.153606 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77454e35-e272-489c-b355-d5dc3caf71c4" containerName="pull" Jul 06 17:49:28.153640 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.153617 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77454e35-e272-489c-b355-d5dc3caf71c4" containerName="pull" Jul 06 17:49:28.153885 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.153705 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="77454e35-e272-489c-b355-d5dc3caf71c4" containerName="extract" Jul 06 17:49:28.155888 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.155866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.159148 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.159124 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 17:49:28.159280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.159250 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mmw7p\"" Jul 06 17:49:28.159280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.159268 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 17:49:28.159456 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.159439 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 17:49:28.159525 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.159512 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 17:49:28.174142 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.174118 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l"] Jul 06 17:49:28.279590 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.279529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4228fc90-b006-426b-8102-15ff7f8c5b74-webhook-cert\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.279968 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.279595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4228fc90-b006-426b-8102-15ff7f8c5b74-manifests\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.279968 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.279657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4228fc90-b006-426b-8102-15ff7f8c5b74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.279968 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.279696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4228fc90-b006-426b-8102-15ff7f8c5b74-tmp\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.279968 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.279786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prdzh\" (UniqueName: \"kubernetes.io/projected/4228fc90-b006-426b-8102-15ff7f8c5b74-kube-api-access-prdzh\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.325258 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.325221 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.380749 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.380667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prdzh\" (UniqueName: \"kubernetes.io/projected/4228fc90-b006-426b-8102-15ff7f8c5b74-kube-api-access-prdzh\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.380749 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.380704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4228fc90-b006-426b-8102-15ff7f8c5b74-webhook-cert\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.380749 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.380726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4228fc90-b006-426b-8102-15ff7f8c5b74-manifests\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.380990 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.380797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4228fc90-b006-426b-8102-15ff7f8c5b74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.380990 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.380847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4228fc90-b006-426b-8102-15ff7f8c5b74-tmp\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.381088 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.381038 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4228fc90-b006-426b-8102-15ff7f8c5b74-manifests\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.383166 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.383142 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4228fc90-b006-426b-8102-15ff7f8c5b74-tmp\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.383363 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.383301 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4228fc90-b006-426b-8102-15ff7f8c5b74-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.383501 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.383427 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4228fc90-b006-426b-8102-15ff7f8c5b74-webhook-cert\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.389012 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.388989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prdzh\" (UniqueName: \"kubernetes.io/projected/4228fc90-b006-426b-8102-15ff7f8c5b74-kube-api-access-prdzh\") pod \"opendatahub-operator-controller-manager-74668f54-w8f8l\" (UID: \"4228fc90-b006-426b-8102-15ff7f8c5b74\") " pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.426282 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.426253 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.466255 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.466223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:28.527102 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.527049 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.600293 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.600252 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.607609 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.607586 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l"] Jul 06 17:49:28.609847 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:49:28.609818 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4228fc90_b006_426b_8102_15ff7f8c5b74.slice/crio-9c499e57f8c244e7458d3b70def36545c3d51b1f47013915e340b04e29a176f6 WatchSource:0}: Error finding container 9c499e57f8c244e7458d3b70def36545c3d51b1f47013915e340b04e29a176f6: Status 404 returned error can't find the container with id 9c499e57f8c244e7458d3b70def36545c3d51b1f47013915e340b04e29a176f6 Jul 06 17:49:28.655846 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.655770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.756842 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.756806 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.861496 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.861465 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:28.938786 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:28.938751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" event={"ID":"4228fc90-b006-426b-8102-15ff7f8c5b74","Type":"ContainerStarted","Data":"9c499e57f8c244e7458d3b70def36545c3d51b1f47013915e340b04e29a176f6"} Jul 06 17:49:31.527316 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:31.527224 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:31.637745 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:31.637706 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:31.956946 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:31.956911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" event={"ID":"4228fc90-b006-426b-8102-15ff7f8c5b74","Type":"ContainerStarted","Data":"89a397225fa63d7c4e7143421fe49a6fcf756f39529538def4c67e60f77c8dac"} Jul 06 17:49:33.968674 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:33.968638 2577 generic.go:356] "Generic (PLEG): container finished" podID="4228fc90-b006-426b-8102-15ff7f8c5b74" containerID="89a397225fa63d7c4e7143421fe49a6fcf756f39529538def4c67e60f77c8dac" exitCode=0 Jul 06 17:49:33.969078 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:33.968710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" event={"ID":"4228fc90-b006-426b-8102-15ff7f8c5b74","Type":"ContainerDied","Data":"89a397225fa63d7c4e7143421fe49a6fcf756f39529538def4c67e60f77c8dac"} Jul 06 17:49:34.975752 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:34.975716 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" event={"ID":"4228fc90-b006-426b-8102-15ff7f8c5b74","Type":"ContainerStarted","Data":"1b91237a7582cd3c046a34107c5fd3d84711fdf8895a8924051508515459d3ea"} Jul 06 17:49:34.976194 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:34.975946 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:34.997350 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:34.997309 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" podStartSLOduration=2.295719702 podStartE2EDuration="6.997295652s" totalImagesPullingTime="3.473519343s" totalInitContainerRuntime="1.228056607s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:49:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:49:34.995335248 +0000 UTC m=+542.705219826" watchObservedRunningTime="2026-07-06 17:49:34.997295652 +0000 UTC m=+542.707180203" Jul 06 17:49:45.984653 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:45.984622 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74668f54-w8f8l" Jul 06 17:49:47.423805 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:47.423769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:47.977183 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:47.977150 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-98dc6956-bzjw6"] Jul 06 17:49:47.985783 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:47.985758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:47.988750 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:47.988725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 17:49:47.988882 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:47.988830 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 17:49:47.990731 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:47.990580 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dfr6c\"" Jul 06 17:49:47.990731 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:47.990598 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 17:49:47.990731 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:47.990618 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 17:49:47.993230 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:47.993211 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-98dc6956-bzjw6"] Jul 06 17:49:48.055835 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.055802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac1fb607-3ee2-4532-b0bb-71d260f56eed-tls-certs\") pod \"kube-auth-proxy-98dc6956-bzjw6\" (UID: \"ac1fb607-3ee2-4532-b0bb-71d260f56eed\") " pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.056004 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.055841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfsg9\" (UniqueName: \"kubernetes.io/projected/ac1fb607-3ee2-4532-b0bb-71d260f56eed-kube-api-access-sfsg9\") pod \"kube-auth-proxy-98dc6956-bzjw6\" (UID: \"ac1fb607-3ee2-4532-b0bb-71d260f56eed\") " pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.056004 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.055909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac1fb607-3ee2-4532-b0bb-71d260f56eed-tmp\") pod \"kube-auth-proxy-98dc6956-bzjw6\" (UID: \"ac1fb607-3ee2-4532-b0bb-71d260f56eed\") " pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.121333 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.121298 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn"] Jul 06 17:49:48.125124 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.125104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.128108 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.128089 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 17:49:48.128253 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.128144 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 17:49:48.128363 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.128348 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 17:49:48.128500 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.128383 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:49:48.128541 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.128505 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 17:49:48.128812 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.128800 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d8knk\"" Jul 06 17:49:48.138608 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.138590 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn"] Jul 06 17:49:48.157024 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.156998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc4pk\" (UniqueName: \"kubernetes.io/projected/1b75a7dc-fea8-44b7-802f-f3841646e28d-kube-api-access-vc4pk\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.157166 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.157031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1b75a7dc-fea8-44b7-802f-f3841646e28d-manager-config\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.157166 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.157075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac1fb607-3ee2-4532-b0bb-71d260f56eed-tls-certs\") pod \"kube-auth-proxy-98dc6956-bzjw6\" (UID: \"ac1fb607-3ee2-4532-b0bb-71d260f56eed\") " pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.157166 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.157104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfsg9\" (UniqueName: \"kubernetes.io/projected/ac1fb607-3ee2-4532-b0bb-71d260f56eed-kube-api-access-sfsg9\") pod \"kube-auth-proxy-98dc6956-bzjw6\" (UID: \"ac1fb607-3ee2-4532-b0bb-71d260f56eed\") " pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.157166 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.157130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b75a7dc-fea8-44b7-802f-f3841646e28d-cert\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.157166 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.157149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b75a7dc-fea8-44b7-802f-f3841646e28d-metrics-cert\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.157327 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.157174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac1fb607-3ee2-4532-b0bb-71d260f56eed-tmp\") pod \"kube-auth-proxy-98dc6956-bzjw6\" (UID: \"ac1fb607-3ee2-4532-b0bb-71d260f56eed\") " pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.159344 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.159289 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac1fb607-3ee2-4532-b0bb-71d260f56eed-tmp\") pod \"kube-auth-proxy-98dc6956-bzjw6\" (UID: \"ac1fb607-3ee2-4532-b0bb-71d260f56eed\") " pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.159501 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.159485 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac1fb607-3ee2-4532-b0bb-71d260f56eed-tls-certs\") pod \"kube-auth-proxy-98dc6956-bzjw6\" (UID: \"ac1fb607-3ee2-4532-b0bb-71d260f56eed\") " pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.178975 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.178951 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfsg9\" (UniqueName: \"kubernetes.io/projected/ac1fb607-3ee2-4532-b0bb-71d260f56eed-kube-api-access-sfsg9\") pod \"kube-auth-proxy-98dc6956-bzjw6\" (UID: \"ac1fb607-3ee2-4532-b0bb-71d260f56eed\") " pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.258211 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.258124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b75a7dc-fea8-44b7-802f-f3841646e28d-cert\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.258211 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.258165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b75a7dc-fea8-44b7-802f-f3841646e28d-metrics-cert\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.258445 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.258220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc4pk\" (UniqueName: \"kubernetes.io/projected/1b75a7dc-fea8-44b7-802f-f3841646e28d-kube-api-access-vc4pk\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.258445 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.258248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1b75a7dc-fea8-44b7-802f-f3841646e28d-manager-config\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.258959 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.258937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1b75a7dc-fea8-44b7-802f-f3841646e28d-manager-config\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.260615 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.260587 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1b75a7dc-fea8-44b7-802f-f3841646e28d-metrics-cert\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.260714 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.260648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b75a7dc-fea8-44b7-802f-f3841646e28d-cert\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.267047 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.267023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc4pk\" (UniqueName: \"kubernetes.io/projected/1b75a7dc-fea8-44b7-802f-f3841646e28d-kube-api-access-vc4pk\") pod \"lws-controller-manager-7768b55bcf-c54bn\" (UID: \"1b75a7dc-fea8-44b7-802f-f3841646e28d\") " pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.297674 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.297644 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" Jul 06 17:49:48.434129 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.434100 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:48.438919 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.438897 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-98dc6956-bzjw6"] Jul 06 17:49:48.441211 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:49:48.441182 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1fb607_3ee2_4532_b0bb_71d260f56eed.slice/crio-7e0aa891bc8710f39023ceedbb93350c045aa2717f05e81a1d743386832429c0 WatchSource:0}: Error finding container 7e0aa891bc8710f39023ceedbb93350c045aa2717f05e81a1d743386832429c0: Status 404 returned error can't find the container with id 7e0aa891bc8710f39023ceedbb93350c045aa2717f05e81a1d743386832429c0 Jul 06 17:49:48.479914 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.479867 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:48.577695 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:48.577664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn"] Jul 06 17:49:48.580539 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:49:48.580506 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b75a7dc_fea8_44b7_802f_f3841646e28d.slice/crio-5c9df0b2d59ffb89913cc5d1ba5442ce8f5a3c1a486894d653e8a8be3a3c7e85 WatchSource:0}: Error finding container 5c9df0b2d59ffb89913cc5d1ba5442ce8f5a3c1a486894d653e8a8be3a3c7e85: Status 404 returned error can't find the container with id 5c9df0b2d59ffb89913cc5d1ba5442ce8f5a3c1a486894d653e8a8be3a3c7e85 Jul 06 17:49:49.049527 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:49.049488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" event={"ID":"1b75a7dc-fea8-44b7-802f-f3841646e28d","Type":"ContainerStarted","Data":"5c9df0b2d59ffb89913cc5d1ba5442ce8f5a3c1a486894d653e8a8be3a3c7e85"} Jul 06 17:49:49.050689 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:49.050658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" event={"ID":"ac1fb607-3ee2-4532-b0bb-71d260f56eed","Type":"ContainerStarted","Data":"7e0aa891bc8710f39023ceedbb93350c045aa2717f05e81a1d743386832429c0"} Jul 06 17:49:49.101716 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:49.101681 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:49.192081 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:49.192033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:49.337145 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:49.337044 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:50.008959 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:50.008925 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:51.065490 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:51.065454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" event={"ID":"1b75a7dc-fea8-44b7-802f-f3841646e28d","Type":"ContainerStarted","Data":"430c5176a1d3d9ffd3f5518887642a5cbd9ebd9dbbb3c3f1ca7c57c949c40064"} Jul 06 17:49:51.065890 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:51.065593 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:49:51.083383 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:51.083330 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" podStartSLOduration=1.6546206460000001 podStartE2EDuration="3.083309989s" totalImagesPullingTime="1.428689343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:49:51.082235534 +0000 UTC m=+558.792120086" watchObservedRunningTime="2026-07-06 17:49:51.083309989 +0000 UTC m=+558.793194542" Jul 06 17:49:53.078257 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:53.078216 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" event={"ID":"ac1fb607-3ee2-4532-b0bb-71d260f56eed","Type":"ContainerStarted","Data":"581c4ca1f16602de45d785883e2a65c160d477fb1cd8d9c4669a5e0f1b1257ec"} Jul 06 17:49:53.096128 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:53.096077 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-98dc6956-bzjw6" podStartSLOduration=2.103645893 podStartE2EDuration="6.096062392s" totalImagesPullingTime="3.992416499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:49:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:49:53.094047883 +0000 UTC m=+560.803932435" watchObservedRunningTime="2026-07-06 17:49:53.096062392 +0000 UTC m=+560.805946944" Jul 06 17:49:54.283476 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:54.283433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:54.396666 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:54.396632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:54.572268 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:54.572176 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:54.722488 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:54.722445 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:54.818061 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:54.818023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:56.708884 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:56.708854 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:58.579117 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:58.579078 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:58.712903 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:58.712870 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:58.918247 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:58.918155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:59.020306 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:59.020266 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:59.121315 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:49:59.121273 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:02.073697 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:50:02.073664 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7768b55bcf-c54bn" Jul 06 17:50:17.855049 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:50:17.855005 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:48.886218 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:50:48.886180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:48.997319 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:50:48.997279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:49.072734 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:50:49.072701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:04.398452 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.398418 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2"] Jul 06 17:51:04.402171 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.402154 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.404965 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.404943 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 17:51:04.405104 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.405065 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 17:51:04.406485 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.406462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2ztcp\"" Jul 06 17:51:04.409061 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.409042 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2"] Jul 06 17:51:04.551087 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.551050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.551255 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.551096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.551255 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.551123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5g29\" (UniqueName: \"kubernetes.io/projected/df645b46-4ccf-4cee-b9f3-e031d5633094-kube-api-access-n5g29\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.651782 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.651681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.651782 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.651740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.651782 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.651764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5g29\" (UniqueName: \"kubernetes.io/projected/df645b46-4ccf-4cee-b9f3-e031d5633094-kube-api-access-n5g29\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.652226 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.652197 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.652262 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.652204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.660243 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.660216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5g29\" (UniqueName: \"kubernetes.io/projected/df645b46-4ccf-4cee-b9f3-e031d5633094-kube-api-access-n5g29\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.711900 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.711860 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:04.842260 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.842237 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2"] Jul 06 17:51:04.844217 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:51:04.844177 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf645b46_4ccf_4cee_b9f3_e031d5633094.slice/crio-06c241aff1117906190b55ee5ba4fb385a44eeb450ba10755c89f90c65f3f2d0 WatchSource:0}: Error finding container 06c241aff1117906190b55ee5ba4fb385a44eeb450ba10755c89f90c65f3f2d0: Status 404 returned error can't find the container with id 06c241aff1117906190b55ee5ba4fb385a44eeb450ba10755c89f90c65f3f2d0 Jul 06 17:51:04.993263 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.993230 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q"] Jul 06 17:51:04.996824 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:04.996808 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.003471 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.003421 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q"] Jul 06 17:51:05.157354 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.157313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.157590 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.157472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h8lp\" (UniqueName: \"kubernetes.io/projected/3b326c3d-18e3-4943-942a-f6ebd8daea66-kube-api-access-5h8lp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.157590 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.157512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.258612 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.258507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h8lp\" (UniqueName: \"kubernetes.io/projected/3b326c3d-18e3-4943-942a-f6ebd8daea66-kube-api-access-5h8lp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.258612 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.258543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.258813 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.258654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.258943 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.258923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.258988 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.258973 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.267783 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.267756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h8lp\" (UniqueName: \"kubernetes.io/projected/3b326c3d-18e3-4943-942a-f6ebd8daea66-kube-api-access-5h8lp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.307305 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.307280 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:05.397524 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.397483 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn"] Jul 06 17:51:05.401866 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.401845 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.409564 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.409522 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn"] Jul 06 17:51:05.442506 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.442481 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q"] Jul 06 17:51:05.444281 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:51:05.444259 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b326c3d_18e3_4943_942a_f6ebd8daea66.slice/crio-fe9638cef5566624c7b8b0db4e1a787140c996ef2156ca7efa452969ec1c24ed WatchSource:0}: Error finding container fe9638cef5566624c7b8b0db4e1a787140c996ef2156ca7efa452969ec1c24ed: Status 404 returned error can't find the container with id fe9638cef5566624c7b8b0db4e1a787140c996ef2156ca7efa452969ec1c24ed Jul 06 17:51:05.445340 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.445313 2577 generic.go:356] "Generic (PLEG): container finished" podID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerID="2fd2883c462560d2730c26f86582655649d059b081a4d30fa0e20db94e6f0573" exitCode=0 Jul 06 17:51:05.445434 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.445343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" event={"ID":"df645b46-4ccf-4cee-b9f3-e031d5633094","Type":"ContainerDied","Data":"2fd2883c462560d2730c26f86582655649d059b081a4d30fa0e20db94e6f0573"} Jul 06 17:51:05.445434 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.445390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" event={"ID":"df645b46-4ccf-4cee-b9f3-e031d5633094","Type":"ContainerStarted","Data":"06c241aff1117906190b55ee5ba4fb385a44eeb450ba10755c89f90c65f3f2d0"} Jul 06 17:51:05.561403 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.561378 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjnn\" (UniqueName: \"kubernetes.io/projected/f295aafd-046c-43ce-8b61-c11da6c0fa16-kube-api-access-svjnn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.561587 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.561418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.561587 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.561444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.662198 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.662166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjnn\" (UniqueName: \"kubernetes.io/projected/f295aafd-046c-43ce-8b61-c11da6c0fa16-kube-api-access-svjnn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.662377 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.662215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.662377 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.662237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.662706 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.662682 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.662804 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.662709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.671268 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.671239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjnn\" (UniqueName: \"kubernetes.io/projected/f295aafd-046c-43ce-8b61-c11da6c0fa16-kube-api-access-svjnn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.713699 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.713663 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:05.801626 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.801594 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt"] Jul 06 17:51:05.806244 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.806222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:05.811014 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.810989 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt"] Jul 06 17:51:05.848027 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.848003 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn"] Jul 06 17:51:05.849864 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:51:05.849828 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf295aafd_046c_43ce_8b61_c11da6c0fa16.slice/crio-0eeb5366cae8f8af33010b943579e602c88aaa49356132afac54df1c335c50d4 WatchSource:0}: Error finding container 0eeb5366cae8f8af33010b943579e602c88aaa49356132afac54df1c335c50d4: Status 404 returned error can't find the container with id 0eeb5366cae8f8af33010b943579e602c88aaa49356132afac54df1c335c50d4 Jul 06 17:51:05.964895 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.964868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:05.965030 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.964910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:05.965030 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:05.964986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgf5f\" (UniqueName: \"kubernetes.io/projected/f57ab857-acaa-4eb1-8d31-f64baee7cf02-kube-api-access-xgf5f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:06.066065 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.065999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:06.066065 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.066046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:06.066234 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.066102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgf5f\" (UniqueName: \"kubernetes.io/projected/f57ab857-acaa-4eb1-8d31-f64baee7cf02-kube-api-access-xgf5f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:06.066356 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.066335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:06.066399 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.066380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:06.076365 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.076339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgf5f\" (UniqueName: \"kubernetes.io/projected/f57ab857-acaa-4eb1-8d31-f64baee7cf02-kube-api-access-xgf5f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:06.118178 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.118139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:06.275025 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.274839 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt"] Jul 06 17:51:06.277263 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:51:06.277231 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57ab857_acaa_4eb1_8d31_f64baee7cf02.slice/crio-0a2623702bd58c1233843da12149fedebd813473b160165be042cace8b955a93 WatchSource:0}: Error finding container 0a2623702bd58c1233843da12149fedebd813473b160165be042cace8b955a93: Status 404 returned error can't find the container with id 0a2623702bd58c1233843da12149fedebd813473b160165be042cace8b955a93 Jul 06 17:51:06.454497 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.454462 2577 generic.go:356] "Generic (PLEG): container finished" podID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerID="f87f4ebc208ca38985f04515f1102788cb37376a755bd39aa5f889cfa267d27c" exitCode=0 Jul 06 17:51:06.454926 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.454543 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" event={"ID":"df645b46-4ccf-4cee-b9f3-e031d5633094","Type":"ContainerDied","Data":"f87f4ebc208ca38985f04515f1102788cb37376a755bd39aa5f889cfa267d27c"} Jul 06 17:51:06.456108 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.456071 2577 generic.go:356] "Generic (PLEG): container finished" podID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerID="844d2c0231d7c581a975218ca30930ad7ead62ca4eb0c4bc8231a1e7a1e40cec" exitCode=0 Jul 06 17:51:06.456185 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.456162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" event={"ID":"f295aafd-046c-43ce-8b61-c11da6c0fa16","Type":"ContainerDied","Data":"844d2c0231d7c581a975218ca30930ad7ead62ca4eb0c4bc8231a1e7a1e40cec"} Jul 06 17:51:06.456251 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.456213 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" event={"ID":"f295aafd-046c-43ce-8b61-c11da6c0fa16","Type":"ContainerStarted","Data":"0eeb5366cae8f8af33010b943579e602c88aaa49356132afac54df1c335c50d4"} Jul 06 17:51:06.457765 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.457744 2577 generic.go:356] "Generic (PLEG): container finished" podID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerID="cdb48e9725f1d4d51b37aa45d857ea6bc0c1962402b6902c0d2f3f1568a4a38c" exitCode=0 Jul 06 17:51:06.457866 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.457809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" event={"ID":"f57ab857-acaa-4eb1-8d31-f64baee7cf02","Type":"ContainerDied","Data":"cdb48e9725f1d4d51b37aa45d857ea6bc0c1962402b6902c0d2f3f1568a4a38c"} Jul 06 17:51:06.457866 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.457838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" event={"ID":"f57ab857-acaa-4eb1-8d31-f64baee7cf02","Type":"ContainerStarted","Data":"0a2623702bd58c1233843da12149fedebd813473b160165be042cace8b955a93"} Jul 06 17:51:06.459603 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.459579 2577 generic.go:356] "Generic (PLEG): container finished" podID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerID="fc5681b59d8e6a86676ab961879410800a53ebcb38d5c353802da8a4d2ae27e0" exitCode=0 Jul 06 17:51:06.459705 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.459648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" event={"ID":"3b326c3d-18e3-4943-942a-f6ebd8daea66","Type":"ContainerDied","Data":"fc5681b59d8e6a86676ab961879410800a53ebcb38d5c353802da8a4d2ae27e0"} Jul 06 17:51:06.459705 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:06.459679 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" event={"ID":"3b326c3d-18e3-4943-942a-f6ebd8daea66","Type":"ContainerStarted","Data":"fe9638cef5566624c7b8b0db4e1a787140c996ef2156ca7efa452969ec1c24ed"} Jul 06 17:51:07.466739 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:07.466637 2577 generic.go:356] "Generic (PLEG): container finished" podID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerID="129c4b64b2455c49e6d87e4af48e02656206eac57dca0471b9bbac0e50dd74d0" exitCode=0 Jul 06 17:51:07.466739 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:07.466724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" event={"ID":"df645b46-4ccf-4cee-b9f3-e031d5633094","Type":"ContainerDied","Data":"129c4b64b2455c49e6d87e4af48e02656206eac57dca0471b9bbac0e50dd74d0"} Jul 06 17:51:07.468413 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:07.468387 2577 generic.go:356] "Generic (PLEG): container finished" podID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerID="56ab764f635f9d90fc5c7e78ce521f144116ba4db5b9a9895352b4e511e7ead0" exitCode=0 Jul 06 17:51:07.468534 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:07.468470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" event={"ID":"f295aafd-046c-43ce-8b61-c11da6c0fa16","Type":"ContainerDied","Data":"56ab764f635f9d90fc5c7e78ce521f144116ba4db5b9a9895352b4e511e7ead0"} Jul 06 17:51:07.470360 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:07.470336 2577 generic.go:356] "Generic (PLEG): container finished" podID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerID="471199f58d0c994ce476ba67c225417813f708b4c176f2cdc1f86e64323e8216" exitCode=0 Jul 06 17:51:07.470499 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:07.470410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" event={"ID":"f57ab857-acaa-4eb1-8d31-f64baee7cf02","Type":"ContainerDied","Data":"471199f58d0c994ce476ba67c225417813f708b4c176f2cdc1f86e64323e8216"} Jul 06 17:51:07.472398 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:07.472379 2577 generic.go:356] "Generic (PLEG): container finished" podID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerID="b216cf4d6132e48e7d9d248e4199bcd42fd9a0bc285b0805cde0753dc958c554" exitCode=0 Jul 06 17:51:07.472501 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:07.472448 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" event={"ID":"3b326c3d-18e3-4943-942a-f6ebd8daea66","Type":"ContainerDied","Data":"b216cf4d6132e48e7d9d248e4199bcd42fd9a0bc285b0805cde0753dc958c554"} Jul 06 17:51:08.479829 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.479794 2577 generic.go:356] "Generic (PLEG): container finished" podID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerID="3ecfdb08bac314ac649ed284534d4609dceb3c25ecc1abd1a493646de51f14d9" exitCode=0 Jul 06 17:51:08.480262 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.479874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" event={"ID":"f295aafd-046c-43ce-8b61-c11da6c0fa16","Type":"ContainerDied","Data":"3ecfdb08bac314ac649ed284534d4609dceb3c25ecc1abd1a493646de51f14d9"} Jul 06 17:51:08.482022 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.481994 2577 generic.go:356] "Generic (PLEG): container finished" podID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerID="40d69feb46e5bd29f95f45ef2a89e25628455b612d28a149bb87b7d9301c65cf" exitCode=0 Jul 06 17:51:08.482158 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.482067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" event={"ID":"f57ab857-acaa-4eb1-8d31-f64baee7cf02","Type":"ContainerDied","Data":"40d69feb46e5bd29f95f45ef2a89e25628455b612d28a149bb87b7d9301c65cf"} Jul 06 17:51:08.484063 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.484040 2577 generic.go:356] "Generic (PLEG): container finished" podID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerID="56fc470fa4ba48c035fbe1dbb86ec5489a70ea5ffecfb463daed028fdab26c12" exitCode=0 Jul 06 17:51:08.484168 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.484121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" event={"ID":"3b326c3d-18e3-4943-942a-f6ebd8daea66","Type":"ContainerDied","Data":"56fc470fa4ba48c035fbe1dbb86ec5489a70ea5ffecfb463daed028fdab26c12"} Jul 06 17:51:08.614987 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.614959 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:08.792070 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.791977 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5g29\" (UniqueName: \"kubernetes.io/projected/df645b46-4ccf-4cee-b9f3-e031d5633094-kube-api-access-n5g29\") pod \"df645b46-4ccf-4cee-b9f3-e031d5633094\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " Jul 06 17:51:08.792226 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.792087 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-util\") pod \"df645b46-4ccf-4cee-b9f3-e031d5633094\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " Jul 06 17:51:08.792226 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.792136 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-bundle\") pod \"df645b46-4ccf-4cee-b9f3-e031d5633094\" (UID: \"df645b46-4ccf-4cee-b9f3-e031d5633094\") " Jul 06 17:51:08.792671 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.792638 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-bundle" (OuterVolumeSpecName: "bundle") pod "df645b46-4ccf-4cee-b9f3-e031d5633094" (UID: "df645b46-4ccf-4cee-b9f3-e031d5633094"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:51:08.794280 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.794262 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df645b46-4ccf-4cee-b9f3-e031d5633094-kube-api-access-n5g29" (OuterVolumeSpecName: "kube-api-access-n5g29") pod "df645b46-4ccf-4cee-b9f3-e031d5633094" (UID: "df645b46-4ccf-4cee-b9f3-e031d5633094"). InnerVolumeSpecName "kube-api-access-n5g29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:51:08.797358 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.797338 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-util" (OuterVolumeSpecName: "util") pod "df645b46-4ccf-4cee-b9f3-e031d5633094" (UID: "df645b46-4ccf-4cee-b9f3-e031d5633094"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:51:08.893625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.893590 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:08.893625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.893622 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5g29\" (UniqueName: \"kubernetes.io/projected/df645b46-4ccf-4cee-b9f3-e031d5633094-kube-api-access-n5g29\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:08.893625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:08.893632 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df645b46-4ccf-4cee-b9f3-e031d5633094-util\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:09.491340 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.491310 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" Jul 06 17:51:09.491771 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.491365 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2" event={"ID":"df645b46-4ccf-4cee-b9f3-e031d5633094","Type":"ContainerDied","Data":"06c241aff1117906190b55ee5ba4fb385a44eeb450ba10755c89f90c65f3f2d0"} Jul 06 17:51:09.491771 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.491415 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06c241aff1117906190b55ee5ba4fb385a44eeb450ba10755c89f90c65f3f2d0" Jul 06 17:51:09.630740 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.630714 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:09.671446 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.671424 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:09.674504 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.674483 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:09.802377 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.802349 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-bundle\") pod \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " Jul 06 17:51:09.802503 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.802404 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-bundle\") pod \"f295aafd-046c-43ce-8b61-c11da6c0fa16\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " Jul 06 17:51:09.802503 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.802437 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-util\") pod \"f295aafd-046c-43ce-8b61-c11da6c0fa16\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " Jul 06 17:51:09.802503 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.802483 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-util\") pod \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " Jul 06 17:51:09.802503 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.802500 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgf5f\" (UniqueName: \"kubernetes.io/projected/f57ab857-acaa-4eb1-8d31-f64baee7cf02-kube-api-access-xgf5f\") pod \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\" (UID: \"f57ab857-acaa-4eb1-8d31-f64baee7cf02\") " Jul 06 17:51:09.802772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.802541 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-bundle\") pod \"3b326c3d-18e3-4943-942a-f6ebd8daea66\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " Jul 06 17:51:09.802772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.802602 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-util\") pod \"3b326c3d-18e3-4943-942a-f6ebd8daea66\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " Jul 06 17:51:09.802772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.802638 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svjnn\" (UniqueName: \"kubernetes.io/projected/f295aafd-046c-43ce-8b61-c11da6c0fa16-kube-api-access-svjnn\") pod \"f295aafd-046c-43ce-8b61-c11da6c0fa16\" (UID: \"f295aafd-046c-43ce-8b61-c11da6c0fa16\") " Jul 06 17:51:09.802772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.802680 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h8lp\" (UniqueName: \"kubernetes.io/projected/3b326c3d-18e3-4943-942a-f6ebd8daea66-kube-api-access-5h8lp\") pod \"3b326c3d-18e3-4943-942a-f6ebd8daea66\" (UID: \"3b326c3d-18e3-4943-942a-f6ebd8daea66\") " Jul 06 17:51:09.803513 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.803010 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-bundle" (OuterVolumeSpecName: "bundle") pod "f57ab857-acaa-4eb1-8d31-f64baee7cf02" (UID: "f57ab857-acaa-4eb1-8d31-f64baee7cf02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:51:09.803513 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.803281 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-bundle" (OuterVolumeSpecName: "bundle") pod "f295aafd-046c-43ce-8b61-c11da6c0fa16" (UID: "f295aafd-046c-43ce-8b61-c11da6c0fa16"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:51:09.803833 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.803780 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-bundle" (OuterVolumeSpecName: "bundle") pod "3b326c3d-18e3-4943-942a-f6ebd8daea66" (UID: "3b326c3d-18e3-4943-942a-f6ebd8daea66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:51:09.805177 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.805132 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f295aafd-046c-43ce-8b61-c11da6c0fa16-kube-api-access-svjnn" (OuterVolumeSpecName: "kube-api-access-svjnn") pod "f295aafd-046c-43ce-8b61-c11da6c0fa16" (UID: "f295aafd-046c-43ce-8b61-c11da6c0fa16"). InnerVolumeSpecName "kube-api-access-svjnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:51:09.805268 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.805222 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f57ab857-acaa-4eb1-8d31-f64baee7cf02-kube-api-access-xgf5f" (OuterVolumeSpecName: "kube-api-access-xgf5f") pod "f57ab857-acaa-4eb1-8d31-f64baee7cf02" (UID: "f57ab857-acaa-4eb1-8d31-f64baee7cf02"). InnerVolumeSpecName "kube-api-access-xgf5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:51:09.805406 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.805390 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b326c3d-18e3-4943-942a-f6ebd8daea66-kube-api-access-5h8lp" (OuterVolumeSpecName: "kube-api-access-5h8lp") pod "3b326c3d-18e3-4943-942a-f6ebd8daea66" (UID: "3b326c3d-18e3-4943-942a-f6ebd8daea66"). InnerVolumeSpecName "kube-api-access-5h8lp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:51:09.808945 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.808906 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-util" (OuterVolumeSpecName: "util") pod "f57ab857-acaa-4eb1-8d31-f64baee7cf02" (UID: "f57ab857-acaa-4eb1-8d31-f64baee7cf02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:51:09.810852 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.810832 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-util" (OuterVolumeSpecName: "util") pod "f295aafd-046c-43ce-8b61-c11da6c0fa16" (UID: "f295aafd-046c-43ce-8b61-c11da6c0fa16"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:51:09.811630 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.811599 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-util" (OuterVolumeSpecName: "util") pod "3b326c3d-18e3-4943-942a-f6ebd8daea66" (UID: "3b326c3d-18e3-4943-942a-f6ebd8daea66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:51:09.904056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.904021 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-util\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:09.904056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.904055 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-util\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:09.904056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.904070 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgf5f\" (UniqueName: \"kubernetes.io/projected/f57ab857-acaa-4eb1-8d31-f64baee7cf02-kube-api-access-xgf5f\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:09.904056 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.904084 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:09.904357 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.904097 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b326c3d-18e3-4943-942a-f6ebd8daea66-util\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:09.904357 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.904111 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svjnn\" (UniqueName: \"kubernetes.io/projected/f295aafd-046c-43ce-8b61-c11da6c0fa16-kube-api-access-svjnn\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:09.904357 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.904136 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h8lp\" (UniqueName: \"kubernetes.io/projected/3b326c3d-18e3-4943-942a-f6ebd8daea66-kube-api-access-5h8lp\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:09.904357 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.904161 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f57ab857-acaa-4eb1-8d31-f64baee7cf02-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:09.904357 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:09.904173 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f295aafd-046c-43ce-8b61-c11da6c0fa16-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:51:10.503297 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:10.503272 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" Jul 06 17:51:10.503778 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:10.503262 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt" event={"ID":"f57ab857-acaa-4eb1-8d31-f64baee7cf02","Type":"ContainerDied","Data":"0a2623702bd58c1233843da12149fedebd813473b160165be042cace8b955a93"} Jul 06 17:51:10.503778 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:10.503424 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a2623702bd58c1233843da12149fedebd813473b160165be042cace8b955a93" Jul 06 17:51:10.505168 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:10.505147 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" Jul 06 17:51:10.505292 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:10.505182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q" event={"ID":"3b326c3d-18e3-4943-942a-f6ebd8daea66","Type":"ContainerDied","Data":"fe9638cef5566624c7b8b0db4e1a787140c996ef2156ca7efa452969ec1c24ed"} Jul 06 17:51:10.505292 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:10.505217 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe9638cef5566624c7b8b0db4e1a787140c996ef2156ca7efa452969ec1c24ed" Jul 06 17:51:10.507105 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:10.507079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" event={"ID":"f295aafd-046c-43ce-8b61-c11da6c0fa16","Type":"ContainerDied","Data":"0eeb5366cae8f8af33010b943579e602c88aaa49356132afac54df1c335c50d4"} Jul 06 17:51:10.507105 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:10.507096 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn" Jul 06 17:51:10.507291 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:10.507122 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0eeb5366cae8f8af33010b943579e602c88aaa49356132afac54df1c335c50d4" Jul 06 17:51:11.844675 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:11.844644 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:12.462623 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:12.462588 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:13.467961 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:13.467923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:13.573372 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:13.573336 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:16.689373 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:16.689335 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:19.526723 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:19.526672 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:20.089968 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:20.089936 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:21.846278 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:21.846236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:22.287995 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:22.287962 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:25.290625 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:25.290591 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:25.447607 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:25.447571 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:25.533243 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:25.533201 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:27.064404 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:27.064365 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:27.169978 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:27.169943 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:27.455681 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:27.455650 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:27.558643 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:27.558607 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:30.854381 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:30.854350 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:30.954119 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:30.954085 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:31.159442 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:31.159353 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:31.260159 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:31.260125 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:34.259990 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.259952 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:34.326022 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.325993 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:34.390433 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390400 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb"] Jul 06 17:51:34.390858 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390842 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerName="pull" Jul 06 17:51:34.390858 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390859 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerName="pull" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390867 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerName="util" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390873 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerName="util" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390890 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerName="util" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390899 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerName="util" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390907 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerName="pull" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390912 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerName="pull" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390921 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerName="pull" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390926 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerName="pull" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390942 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerName="util" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390947 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerName="util" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390953 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerName="util" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390958 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerName="util" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390963 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerName="extract" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390970 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerName="extract" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390985 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerName="extract" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390991 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerName="extract" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.390997 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerName="pull" Jul 06 17:51:34.390999 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.391002 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerName="pull" Jul 06 17:51:34.391591 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.391013 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerName="extract" Jul 06 17:51:34.391591 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.391018 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerName="extract" Jul 06 17:51:34.391591 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.391023 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerName="extract" Jul 06 17:51:34.391591 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.391028 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerName="extract" Jul 06 17:51:34.391591 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.391092 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f295aafd-046c-43ce-8b61-c11da6c0fa16" containerName="extract" Jul 06 17:51:34.391591 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.391102 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f57ab857-acaa-4eb1-8d31-f64baee7cf02" containerName="extract" Jul 06 17:51:34.391591 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.391110 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="df645b46-4ccf-4cee-b9f3-e031d5633094" containerName="extract" Jul 06 17:51:34.391591 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.391116 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b326c3d-18e3-4943-942a-f6ebd8daea66" containerName="extract" Jul 06 17:51:34.394154 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.394135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.397178 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.397125 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 17:51:34.397178 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.397151 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2ztcp\"" Jul 06 17:51:34.397649 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.397623 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 17:51:34.398500 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.398464 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 17:51:34.398779 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.398762 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 17:51:34.401004 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.400832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:34.401004 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.400901 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb"] Jul 06 17:51:34.529005 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.528920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/efe79272-6bbb-40b5-b562-606acb0e46fc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cbqxb\" (UID: \"efe79272-6bbb-40b5-b562-606acb0e46fc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.529005 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.528962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfh2s\" (UniqueName: \"kubernetes.io/projected/efe79272-6bbb-40b5-b562-606acb0e46fc-kube-api-access-mfh2s\") pod \"kuadrant-console-plugin-66b5774985-cbqxb\" (UID: \"efe79272-6bbb-40b5-b562-606acb0e46fc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.529246 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.529083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/efe79272-6bbb-40b5-b562-606acb0e46fc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cbqxb\" (UID: \"efe79272-6bbb-40b5-b562-606acb0e46fc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.618964 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.618933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:34.630570 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.630516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/efe79272-6bbb-40b5-b562-606acb0e46fc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cbqxb\" (UID: \"efe79272-6bbb-40b5-b562-606acb0e46fc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.630735 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.630598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/efe79272-6bbb-40b5-b562-606acb0e46fc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cbqxb\" (UID: \"efe79272-6bbb-40b5-b562-606acb0e46fc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.630735 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.630667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfh2s\" (UniqueName: \"kubernetes.io/projected/efe79272-6bbb-40b5-b562-606acb0e46fc-kube-api-access-mfh2s\") pod \"kuadrant-console-plugin-66b5774985-cbqxb\" (UID: \"efe79272-6bbb-40b5-b562-606acb0e46fc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.631414 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.631390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/efe79272-6bbb-40b5-b562-606acb0e46fc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cbqxb\" (UID: \"efe79272-6bbb-40b5-b562-606acb0e46fc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.633020 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.632989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/efe79272-6bbb-40b5-b562-606acb0e46fc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cbqxb\" (UID: \"efe79272-6bbb-40b5-b562-606acb0e46fc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.639736 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.639711 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfh2s\" (UniqueName: \"kubernetes.io/projected/efe79272-6bbb-40b5-b562-606acb0e46fc-kube-api-access-mfh2s\") pod \"kuadrant-console-plugin-66b5774985-cbqxb\" (UID: \"efe79272-6bbb-40b5-b562-606acb0e46fc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.706496 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.706467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" Jul 06 17:51:34.839681 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:34.839657 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb"] Jul 06 17:51:34.840954 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:51:34.840930 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefe79272_6bbb_40b5_b562_606acb0e46fc.slice/crio-2fe219d443e165145d6812985ccf3477a7ac200b3ed07368d357167c7e15a990 WatchSource:0}: Error finding container 2fe219d443e165145d6812985ccf3477a7ac200b3ed07368d357167c7e15a990: Status 404 returned error can't find the container with id 2fe219d443e165145d6812985ccf3477a7ac200b3ed07368d357167c7e15a990 Jul 06 17:51:35.649674 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:35.649643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" event={"ID":"efe79272-6bbb-40b5-b562-606acb0e46fc","Type":"ContainerStarted","Data":"2fe219d443e165145d6812985ccf3477a7ac200b3ed07368d357167c7e15a990"} Jul 06 17:51:38.178980 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:38.178944 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:38.279957 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:38.279916 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:44.210533 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.210500 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml"] Jul 06 17:51:44.213862 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.213845 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:51:44.216840 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.216820 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hbc55\"" Jul 06 17:51:44.224491 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.224467 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml"] Jul 06 17:51:44.324354 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.324314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6l7t\" (UniqueName: \"kubernetes.io/projected/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-kube-api-access-v6l7t\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" (UID: \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:51:44.324524 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.324363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" (UID: \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:51:44.425526 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.425488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6l7t\" (UniqueName: \"kubernetes.io/projected/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-kube-api-access-v6l7t\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" (UID: \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:51:44.425718 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.425533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" (UID: \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:51:44.425913 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.425896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" (UID: \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:51:44.436998 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.436967 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6l7t\" (UniqueName: \"kubernetes.io/projected/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-kube-api-access-v6l7t\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" (UID: \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:51:44.525733 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.525640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:51:44.665309 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.665280 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml"] Jul 06 17:51:44.666753 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:51:44.666727 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7b16b6_34a7_4ced_8b6a_3939bcead8bf.slice/crio-ce4461800c358d6b58fdb1ff210a1bdd49e5694b8c6d84896d64e250f8bf8eed WatchSource:0}: Error finding container ce4461800c358d6b58fdb1ff210a1bdd49e5694b8c6d84896d64e250f8bf8eed: Status 404 returned error can't find the container with id ce4461800c358d6b58fdb1ff210a1bdd49e5694b8c6d84896d64e250f8bf8eed Jul 06 17:51:44.708086 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:44.708049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" event={"ID":"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf","Type":"ContainerStarted","Data":"ce4461800c358d6b58fdb1ff210a1bdd49e5694b8c6d84896d64e250f8bf8eed"} Jul 06 17:51:45.035276 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.035243 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml"] Jul 06 17:51:45.038977 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.038947 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml"] Jul 06 17:51:45.055384 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.055351 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr"] Jul 06 17:51:45.058830 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.058811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:51:45.079046 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.079022 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr"] Jul 06 17:51:45.132080 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.132051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e246e69-da0d-48aa-aebb-2d025719c170-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xxxjr\" (UID: \"3e246e69-da0d-48aa-aebb-2d025719c170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:51:45.132248 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.132113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dghg8\" (UniqueName: \"kubernetes.io/projected/3e246e69-da0d-48aa-aebb-2d025719c170-kube-api-access-dghg8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xxxjr\" (UID: \"3e246e69-da0d-48aa-aebb-2d025719c170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:51:45.233191 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.233154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e246e69-da0d-48aa-aebb-2d025719c170-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xxxjr\" (UID: \"3e246e69-da0d-48aa-aebb-2d025719c170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:51:45.233640 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.233267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dghg8\" (UniqueName: \"kubernetes.io/projected/3e246e69-da0d-48aa-aebb-2d025719c170-kube-api-access-dghg8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xxxjr\" (UID: \"3e246e69-da0d-48aa-aebb-2d025719c170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:51:45.233640 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.233533 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e246e69-da0d-48aa-aebb-2d025719c170-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xxxjr\" (UID: \"3e246e69-da0d-48aa-aebb-2d025719c170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:51:45.241991 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.241959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dghg8\" (UniqueName: \"kubernetes.io/projected/3e246e69-da0d-48aa-aebb-2d025719c170-kube-api-access-dghg8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xxxjr\" (UID: \"3e246e69-da0d-48aa-aebb-2d025719c170\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:51:45.373146 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.373065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:51:45.518357 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.518330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr"] Jul 06 17:51:45.568001 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:51:45.567969 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e246e69_da0d_48aa_aebb_2d025719c170.slice/crio-93f8077f83e0a212b67f8f4c33e3fcd4cf0218fb2ca3e474019807ca6bf2e5a5 WatchSource:0}: Error finding container 93f8077f83e0a212b67f8f4c33e3fcd4cf0218fb2ca3e474019807ca6bf2e5a5: Status 404 returned error can't find the container with id 93f8077f83e0a212b67f8f4c33e3fcd4cf0218fb2ca3e474019807ca6bf2e5a5 Jul 06 17:51:45.717073 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:45.717038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" event={"ID":"3e246e69-da0d-48aa-aebb-2d025719c170","Type":"ContainerStarted","Data":"93f8077f83e0a212b67f8f4c33e3fcd4cf0218fb2ca3e474019807ca6bf2e5a5"} Jul 06 17:51:46.062282 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:46.062181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:46.167683 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:46.167647 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:46.472520 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:46.472487 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:46.566310 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:46.565920 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:49.052018 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:49.051980 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:49.153158 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:49.153117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:52.068583 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:52.068529 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:52.132231 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:52.132196 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:54.687081 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:54.687049 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:54.787878 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:54.787837 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:54.888129 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:54.888080 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:55.638775 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:55.638736 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:55.743180 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:55.743138 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:55.840677 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:55.840642 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:56.357286 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:56.357247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:56.411839 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:56.411803 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:56.590135 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:56.590089 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:56.691279 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:51:56.691243 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:03.838274 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:03.838235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" event={"ID":"3e246e69-da0d-48aa-aebb-2d025719c170","Type":"ContainerStarted","Data":"771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e"} Jul 06 17:52:03.838739 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:03.838328 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:52:03.840052 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:03.840018 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" containerName="manager" containerID="cri-o://6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819" gracePeriod=2 Jul 06 17:52:03.841495 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:03.841469 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" event={"ID":"efe79272-6bbb-40b5-b562-606acb0e46fc","Type":"ContainerStarted","Data":"13e1b829c52725d3386db7318c187aae80beae5042bbdee0361762a8fa387b2c"} Jul 06 17:52:03.862668 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:03.862623 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" podStartSLOduration=0.882498089 podStartE2EDuration="18.862608883s" totalImagesPullingTime="17.980110794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:03.860359587 +0000 UTC m=+691.570244179" watchObservedRunningTime="2026-07-06 17:52:03.862608883 +0000 UTC m=+691.572493412" Jul 06 17:52:03.862803 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:52:03.862688 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" is forbidden: User \"system:node:ip-10-0-133-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-100.ec2.internal' and this object" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:52:03.880537 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:03.880487 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cbqxb" podStartSLOduration=1.184710071 podStartE2EDuration="29.880470978s" totalImagesPullingTime="28.695760907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:03.878869371 +0000 UTC m=+691.588753922" watchObservedRunningTime="2026-07-06 17:52:03.880470978 +0000 UTC m=+691.590355528" Jul 06 17:52:04.115283 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.115252 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:52:04.118039 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:52:04.118013 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" is forbidden: User \"system:node:ip-10-0-133-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-100.ec2.internal' and this object" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:52:04.212888 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.212854 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6l7t\" (UniqueName: \"kubernetes.io/projected/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-kube-api-access-v6l7t\") pod \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\" (UID: \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\") " Jul 06 17:52:04.213079 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.212976 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-extensions-socket-volume\") pod \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\" (UID: \"6a7b16b6-34a7-4ced-8b6a-3939bcead8bf\") " Jul 06 17:52:04.213250 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.213226 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" (UID: "6a7b16b6-34a7-4ced-8b6a-3939bcead8bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:52:04.214977 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.214953 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-kube-api-access-v6l7t" (OuterVolumeSpecName: "kube-api-access-v6l7t") pod "6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" (UID: "6a7b16b6-34a7-4ced-8b6a-3939bcead8bf"). InnerVolumeSpecName "kube-api-access-v6l7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:52:04.314351 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.314277 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-extensions-socket-volume\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:04.314351 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.314302 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6l7t\" (UniqueName: \"kubernetes.io/projected/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf-kube-api-access-v6l7t\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:04.812144 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.812101 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" path="/var/lib/kubelet/pods/6a7b16b6-34a7-4ced-8b6a-3939bcead8bf/volumes" Jul 06 17:52:04.848713 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.848679 2577 generic.go:356] "Generic (PLEG): container finished" podID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" containerID="6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819" exitCode=2 Jul 06 17:52:04.849126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.848718 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:52:04.849126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.848775 2577 scope.go:117] "RemoveContainer" containerID="6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819" Jul 06 17:52:04.851354 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:52:04.851327 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" is forbidden: User \"system:node:ip-10-0-133-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-100.ec2.internal' and this object" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:52:04.853541 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:52:04.853520 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" is forbidden: User \"system:node:ip-10-0-133-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-100.ec2.internal' and this object" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:52:04.857732 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.857716 2577 scope.go:117] "RemoveContainer" containerID="6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819" Jul 06 17:52:04.858022 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:52:04.858002 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819\": container with ID starting with 6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819 not found: ID does not exist" containerID="6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819" Jul 06 17:52:04.858079 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:04.858031 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819"} err="failed to get container status \"6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819\": rpc error: code = NotFound desc = could not find container \"6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819\": container with ID starting with 6e93fdf24753c73e9c5788f38c89ab276b2205ab407981efb0eae00d840ce819 not found: ID does not exist" Jul 06 17:52:06.796491 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:06.796455 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c56f86b-tf72t"] Jul 06 17:52:06.798934 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:52:06.798900 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rhhml\" is forbidden: User \"system:node:ip-10-0-133-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-100.ec2.internal' and this object" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rhhml" Jul 06 17:52:06.897146 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:06.897113 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:06.997578 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:06.997513 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:07.097746 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:07.097652 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:14.851029 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:14.850997 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:52:27.586641 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.586537 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr"] Jul 06 17:52:27.587260 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.586806 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" podUID="3e246e69-da0d-48aa-aebb-2d025719c170" containerName="manager" containerID="cri-o://771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e" gracePeriod=10 Jul 06 17:52:27.839290 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.839220 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:52:27.938957 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.938924 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e246e69-da0d-48aa-aebb-2d025719c170-extensions-socket-volume\") pod \"3e246e69-da0d-48aa-aebb-2d025719c170\" (UID: \"3e246e69-da0d-48aa-aebb-2d025719c170\") " Jul 06 17:52:27.939150 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.938993 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dghg8\" (UniqueName: \"kubernetes.io/projected/3e246e69-da0d-48aa-aebb-2d025719c170-kube-api-access-dghg8\") pod \"3e246e69-da0d-48aa-aebb-2d025719c170\" (UID: \"3e246e69-da0d-48aa-aebb-2d025719c170\") " Jul 06 17:52:27.939516 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.939488 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e246e69-da0d-48aa-aebb-2d025719c170-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3e246e69-da0d-48aa-aebb-2d025719c170" (UID: "3e246e69-da0d-48aa-aebb-2d025719c170"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:52:27.941072 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.941048 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e246e69-da0d-48aa-aebb-2d025719c170-kube-api-access-dghg8" (OuterVolumeSpecName: "kube-api-access-dghg8") pod "3e246e69-da0d-48aa-aebb-2d025719c170" (UID: "3e246e69-da0d-48aa-aebb-2d025719c170"). InnerVolumeSpecName "kube-api-access-dghg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:52:27.980534 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.980498 2577 generic.go:356] "Generic (PLEG): container finished" podID="3e246e69-da0d-48aa-aebb-2d025719c170" containerID="771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e" exitCode=0 Jul 06 17:52:27.980534 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.980543 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" Jul 06 17:52:27.980778 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.980588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" event={"ID":"3e246e69-da0d-48aa-aebb-2d025719c170","Type":"ContainerDied","Data":"771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e"} Jul 06 17:52:27.980778 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.980643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr" event={"ID":"3e246e69-da0d-48aa-aebb-2d025719c170","Type":"ContainerDied","Data":"93f8077f83e0a212b67f8f4c33e3fcd4cf0218fb2ca3e474019807ca6bf2e5a5"} Jul 06 17:52:27.980778 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.980667 2577 scope.go:117] "RemoveContainer" containerID="771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e" Jul 06 17:52:27.990377 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.990360 2577 scope.go:117] "RemoveContainer" containerID="771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e" Jul 06 17:52:27.990647 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:52:27.990627 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e\": container with ID starting with 771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e not found: ID does not exist" containerID="771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e" Jul 06 17:52:27.990694 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:27.990655 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e"} err="failed to get container status \"771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e\": rpc error: code = NotFound desc = could not find container \"771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e\": container with ID starting with 771f95acb829b5a90db6f9f1a327da325d0d69f9c88580c792409d2097644b7e not found: ID does not exist" Jul 06 17:52:28.009561 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:28.009526 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr"] Jul 06 17:52:28.016862 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:28.016824 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xxxjr"] Jul 06 17:52:28.040002 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:28.039972 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e246e69-da0d-48aa-aebb-2d025719c170-extensions-socket-volume\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:28.040002 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:28.039996 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dghg8\" (UniqueName: \"kubernetes.io/projected/3e246e69-da0d-48aa-aebb-2d025719c170-kube-api-access-dghg8\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:28.813196 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:28.813159 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e246e69-da0d-48aa-aebb-2d025719c170" path="/var/lib/kubelet/pods/3e246e69-da0d-48aa-aebb-2d025719c170/volumes" Jul 06 17:52:31.308662 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:31.308581 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:31.817429 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:31.817386 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58c56f86b-tf72t" podUID="17676285-7269-4907-ad29-4b8af045fe38" containerName="console" containerID="cri-o://2d46761f99a6691f5ed2620a0f4235d88752e89249bb390ebd6ca08e408d1c91" gracePeriod=15 Jul 06 17:52:32.004804 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.004773 2577 generic.go:356] "Generic (PLEG): container finished" podID="17676285-7269-4907-ad29-4b8af045fe38" containerID="2d46761f99a6691f5ed2620a0f4235d88752e89249bb390ebd6ca08e408d1c91" exitCode=0 Jul 06 17:52:32.004994 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.004845 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c56f86b-tf72t" event={"ID":"17676285-7269-4907-ad29-4b8af045fe38","Type":"ContainerDied","Data":"2d46761f99a6691f5ed2620a0f4235d88752e89249bb390ebd6ca08e408d1c91"} Jul 06 17:52:32.013231 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.013189 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:32.069875 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.069816 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:52:32.176484 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.176437 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-oauth-serving-cert\") pod \"17676285-7269-4907-ad29-4b8af045fe38\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " Jul 06 17:52:32.176721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.176515 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-oauth-config\") pod \"17676285-7269-4907-ad29-4b8af045fe38\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " Jul 06 17:52:32.176721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.176540 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-serving-cert\") pod \"17676285-7269-4907-ad29-4b8af045fe38\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " Jul 06 17:52:32.176721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.176593 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-service-ca\") pod \"17676285-7269-4907-ad29-4b8af045fe38\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " Jul 06 17:52:32.176721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.176610 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-trusted-ca-bundle\") pod \"17676285-7269-4907-ad29-4b8af045fe38\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " Jul 06 17:52:32.176721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.176643 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-console-config\") pod \"17676285-7269-4907-ad29-4b8af045fe38\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " Jul 06 17:52:32.176721 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.176691 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4qr9\" (UniqueName: \"kubernetes.io/projected/17676285-7269-4907-ad29-4b8af045fe38-kube-api-access-h4qr9\") pod \"17676285-7269-4907-ad29-4b8af045fe38\" (UID: \"17676285-7269-4907-ad29-4b8af045fe38\") " Jul 06 17:52:32.177102 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.177034 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17676285-7269-4907-ad29-4b8af045fe38" (UID: "17676285-7269-4907-ad29-4b8af045fe38"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:52:32.177102 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.177034 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-service-ca" (OuterVolumeSpecName: "service-ca") pod "17676285-7269-4907-ad29-4b8af045fe38" (UID: "17676285-7269-4907-ad29-4b8af045fe38"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:52:32.177235 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.177155 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-console-config" (OuterVolumeSpecName: "console-config") pod "17676285-7269-4907-ad29-4b8af045fe38" (UID: "17676285-7269-4907-ad29-4b8af045fe38"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:52:32.177235 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.177175 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "17676285-7269-4907-ad29-4b8af045fe38" (UID: "17676285-7269-4907-ad29-4b8af045fe38"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:52:32.178845 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.178816 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17676285-7269-4907-ad29-4b8af045fe38" (UID: "17676285-7269-4907-ad29-4b8af045fe38"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:52:32.178930 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.178856 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17676285-7269-4907-ad29-4b8af045fe38-kube-api-access-h4qr9" (OuterVolumeSpecName: "kube-api-access-h4qr9") pod "17676285-7269-4907-ad29-4b8af045fe38" (UID: "17676285-7269-4907-ad29-4b8af045fe38"). InnerVolumeSpecName "kube-api-access-h4qr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:52:32.178930 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.178881 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17676285-7269-4907-ad29-4b8af045fe38" (UID: "17676285-7269-4907-ad29-4b8af045fe38"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:52:32.278270 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.278234 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-console-config\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:32.278270 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.278263 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4qr9\" (UniqueName: \"kubernetes.io/projected/17676285-7269-4907-ad29-4b8af045fe38-kube-api-access-h4qr9\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:32.278270 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.278276 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-oauth-serving-cert\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:32.278514 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.278286 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-oauth-config\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:32.278514 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.278294 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17676285-7269-4907-ad29-4b8af045fe38-console-serving-cert\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:32.278514 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.278302 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-service-ca\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:32.278514 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:32.278310 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17676285-7269-4907-ad29-4b8af045fe38-trusted-ca-bundle\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:33.011243 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:33.011209 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c56f86b-tf72t" Jul 06 17:52:33.011673 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:33.011244 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c56f86b-tf72t" event={"ID":"17676285-7269-4907-ad29-4b8af045fe38","Type":"ContainerDied","Data":"1636fa9a80f48ebc7e438f409d3b3ea0dca1e65213ece27db172c2aee173cac1"} Jul 06 17:52:33.011673 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:33.011324 2577 scope.go:117] "RemoveContainer" containerID="2d46761f99a6691f5ed2620a0f4235d88752e89249bb390ebd6ca08e408d1c91" Jul 06 17:52:33.028822 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:33.028793 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c56f86b-tf72t"] Jul 06 17:52:33.032413 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:33.032382 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58c56f86b-tf72t"] Jul 06 17:52:34.746271 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:34.746236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:34.812321 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:34.812288 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17676285-7269-4907-ad29-4b8af045fe38" path="/var/lib/kubelet/pods/17676285-7269-4907-ad29-4b8af045fe38/volumes" Jul 06 17:52:34.854801 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:34.854763 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:34.951979 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:34.951945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:35.066414 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066328 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:52:35.066740 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066723 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17676285-7269-4907-ad29-4b8af045fe38" containerName="console" Jul 06 17:52:35.066740 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066741 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="17676285-7269-4907-ad29-4b8af045fe38" containerName="console" Jul 06 17:52:35.066853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066753 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" containerName="manager" Jul 06 17:52:35.066853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066758 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" containerName="manager" Jul 06 17:52:35.066853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066768 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e246e69-da0d-48aa-aebb-2d025719c170" containerName="manager" Jul 06 17:52:35.066853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066774 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e246e69-da0d-48aa-aebb-2d025719c170" containerName="manager" Jul 06 17:52:35.066853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066835 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e246e69-da0d-48aa-aebb-2d025719c170" containerName="manager" Jul 06 17:52:35.066853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066845 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="17676285-7269-4907-ad29-4b8af045fe38" containerName="console" Jul 06 17:52:35.066853 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.066851 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a7b16b6-34a7-4ced-8b6a-3939bcead8bf" containerName="manager" Jul 06 17:52:35.555485 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.555454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:35.656921 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.656879 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:35.671953 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.671919 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:52:35.671953 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.671960 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:52:35.672186 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.671983 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-f5wvl"] Jul 06 17:52:35.672186 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.672026 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:35.674929 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.674900 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 17:52:35.696899 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.696873 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5wvl"] Jul 06 17:52:35.697045 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.696968 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5wvl" Jul 06 17:52:35.699906 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.699884 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t6bhg\"" Jul 06 17:52:35.811589 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.811475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pztbc\" (UniqueName: \"kubernetes.io/projected/47986f40-e498-49c1-b77b-4257cc7761d8-kube-api-access-pztbc\") pod \"limitador-limitador-54d6d988d5-5l9dh\" (UID: \"47986f40-e498-49c1-b77b-4257cc7761d8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:35.811589 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.811531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/47986f40-e498-49c1-b77b-4257cc7761d8-config-file\") pod \"limitador-limitador-54d6d988d5-5l9dh\" (UID: \"47986f40-e498-49c1-b77b-4257cc7761d8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:35.812005 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.811657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhx4h\" (UniqueName: \"kubernetes.io/projected/edf249e4-fcc6-4751-a102-4632982d763f-kube-api-access-lhx4h\") pod \"authorino-58cd955675-f5wvl\" (UID: \"edf249e4-fcc6-4751-a102-4632982d763f\") " pod="kuadrant-system/authorino-58cd955675-f5wvl" Jul 06 17:52:35.912856 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.912814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/47986f40-e498-49c1-b77b-4257cc7761d8-config-file\") pod \"limitador-limitador-54d6d988d5-5l9dh\" (UID: \"47986f40-e498-49c1-b77b-4257cc7761d8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:35.913041 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.912883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhx4h\" (UniqueName: \"kubernetes.io/projected/edf249e4-fcc6-4751-a102-4632982d763f-kube-api-access-lhx4h\") pod \"authorino-58cd955675-f5wvl\" (UID: \"edf249e4-fcc6-4751-a102-4632982d763f\") " pod="kuadrant-system/authorino-58cd955675-f5wvl" Jul 06 17:52:35.913041 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.912919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pztbc\" (UniqueName: \"kubernetes.io/projected/47986f40-e498-49c1-b77b-4257cc7761d8-kube-api-access-pztbc\") pod \"limitador-limitador-54d6d988d5-5l9dh\" (UID: \"47986f40-e498-49c1-b77b-4257cc7761d8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:35.913478 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.913459 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/47986f40-e498-49c1-b77b-4257cc7761d8-config-file\") pod \"limitador-limitador-54d6d988d5-5l9dh\" (UID: \"47986f40-e498-49c1-b77b-4257cc7761d8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:35.921343 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.921317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhx4h\" (UniqueName: \"kubernetes.io/projected/edf249e4-fcc6-4751-a102-4632982d763f-kube-api-access-lhx4h\") pod \"authorino-58cd955675-f5wvl\" (UID: \"edf249e4-fcc6-4751-a102-4632982d763f\") " pod="kuadrant-system/authorino-58cd955675-f5wvl" Jul 06 17:52:35.921464 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.921351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pztbc\" (UniqueName: \"kubernetes.io/projected/47986f40-e498-49c1-b77b-4257cc7761d8-kube-api-access-pztbc\") pod \"limitador-limitador-54d6d988d5-5l9dh\" (UID: \"47986f40-e498-49c1-b77b-4257cc7761d8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:35.981970 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:35.981933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:36.006105 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:36.006085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5wvl" Jul 06 17:52:36.142737 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:36.142702 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:52:36.151866 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:52:36.151820 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47986f40_e498_49c1_b77b_4257cc7761d8.slice/crio-c598b5cc8d8cb6d2a18a74edbc28047fd564c1505a49693db5114d48b7744d0b WatchSource:0}: Error finding container c598b5cc8d8cb6d2a18a74edbc28047fd564c1505a49693db5114d48b7744d0b: Status 404 returned error can't find the container with id c598b5cc8d8cb6d2a18a74edbc28047fd564c1505a49693db5114d48b7744d0b Jul 06 17:52:36.155304 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:36.155283 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:52:36.174967 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:36.174939 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5wvl"] Jul 06 17:52:36.176789 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:52:36.176755 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedf249e4_fcc6_4751_a102_4632982d763f.slice/crio-2fa15c0300d0c5a51ecdc4983c508db47a058e7566b5dcca8d9220bfdb2223a2 WatchSource:0}: Error finding container 2fa15c0300d0c5a51ecdc4983c508db47a058e7566b5dcca8d9220bfdb2223a2: Status 404 returned error can't find the container with id 2fa15c0300d0c5a51ecdc4983c508db47a058e7566b5dcca8d9220bfdb2223a2 Jul 06 17:52:37.039357 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:37.039279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" event={"ID":"47986f40-e498-49c1-b77b-4257cc7761d8","Type":"ContainerStarted","Data":"c598b5cc8d8cb6d2a18a74edbc28047fd564c1505a49693db5114d48b7744d0b"} Jul 06 17:52:37.042195 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:37.041703 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5wvl" event={"ID":"edf249e4-fcc6-4751-a102-4632982d763f","Type":"ContainerStarted","Data":"2fa15c0300d0c5a51ecdc4983c508db47a058e7566b5dcca8d9220bfdb2223a2"} Jul 06 17:52:40.695842 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:40.695800 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5wvl"] Jul 06 17:52:41.067206 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:41.067112 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5wvl" event={"ID":"edf249e4-fcc6-4751-a102-4632982d763f","Type":"ContainerStarted","Data":"11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d"} Jul 06 17:52:41.069048 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:41.069018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" event={"ID":"47986f40-e498-49c1-b77b-4257cc7761d8","Type":"ContainerStarted","Data":"d93dfe9929d9b062c493e042a56c9071928f3fce5b38c6b7df0cf695ff43e441"} Jul 06 17:52:41.069200 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:41.069081 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:41.082321 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:41.082268 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-f5wvl" podStartSLOduration=1.84749513 podStartE2EDuration="6.082248283s" totalImagesPullingTime="4.234753153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:41.080864169 +0000 UTC m=+728.790748721" watchObservedRunningTime="2026-07-06 17:52:41.082248283 +0000 UTC m=+728.792132836" Jul 06 17:52:41.104072 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:41.104023 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" podStartSLOduration=1.8860165100000001 podStartE2EDuration="6.104010096s" totalImagesPullingTime="4.217993586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:41.101748763 +0000 UTC m=+728.811633327" watchObservedRunningTime="2026-07-06 17:52:41.104010096 +0000 UTC m=+728.813894649" Jul 06 17:52:42.074155 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:42.074115 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-f5wvl" podUID="edf249e4-fcc6-4751-a102-4632982d763f" containerName="authorino" containerID="cri-o://11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d" gracePeriod=30 Jul 06 17:52:42.328665 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:42.328605 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5wvl" Jul 06 17:52:42.372087 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:42.372050 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhx4h\" (UniqueName: \"kubernetes.io/projected/edf249e4-fcc6-4751-a102-4632982d763f-kube-api-access-lhx4h\") pod \"edf249e4-fcc6-4751-a102-4632982d763f\" (UID: \"edf249e4-fcc6-4751-a102-4632982d763f\") " Jul 06 17:52:42.374057 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:42.374025 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf249e4-fcc6-4751-a102-4632982d763f-kube-api-access-lhx4h" (OuterVolumeSpecName: "kube-api-access-lhx4h") pod "edf249e4-fcc6-4751-a102-4632982d763f" (UID: "edf249e4-fcc6-4751-a102-4632982d763f"). InnerVolumeSpecName "kube-api-access-lhx4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:52:42.473328 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:42.473274 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhx4h\" (UniqueName: \"kubernetes.io/projected/edf249e4-fcc6-4751-a102-4632982d763f-kube-api-access-lhx4h\") on node \"ip-10-0-133-100.ec2.internal\" DevicePath \"\"" Jul 06 17:52:43.079985 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:43.079900 2577 generic.go:356] "Generic (PLEG): container finished" podID="edf249e4-fcc6-4751-a102-4632982d763f" containerID="11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d" exitCode=0 Jul 06 17:52:43.079985 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:43.079942 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5wvl" Jul 06 17:52:43.080466 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:43.079982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5wvl" event={"ID":"edf249e4-fcc6-4751-a102-4632982d763f","Type":"ContainerDied","Data":"11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d"} Jul 06 17:52:43.080466 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:43.080026 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5wvl" event={"ID":"edf249e4-fcc6-4751-a102-4632982d763f","Type":"ContainerDied","Data":"2fa15c0300d0c5a51ecdc4983c508db47a058e7566b5dcca8d9220bfdb2223a2"} Jul 06 17:52:43.080466 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:43.080047 2577 scope.go:117] "RemoveContainer" containerID="11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d" Jul 06 17:52:43.089060 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:43.089038 2577 scope.go:117] "RemoveContainer" containerID="11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d" Jul 06 17:52:43.089333 ip-10-0-133-100 kubenswrapper[2577]: E0706 17:52:43.089311 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d\": container with ID starting with 11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d not found: ID does not exist" containerID="11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d" Jul 06 17:52:43.089388 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:43.089342 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d"} err="failed to get container status \"11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d\": rpc error: code = NotFound desc = could not find container \"11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d\": container with ID starting with 11539fde06a5966182b5ac2199a55b1b8e195addae2dd51ea74bcd7d11b0ab6d not found: ID does not exist" Jul 06 17:52:43.097099 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:43.097064 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5wvl"] Jul 06 17:52:43.105847 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:43.105821 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5wvl"] Jul 06 17:52:44.812805 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:44.812773 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edf249e4-fcc6-4751-a102-4632982d763f" path="/var/lib/kubelet/pods/edf249e4-fcc6-4751-a102-4632982d763f/volumes" Jul 06 17:52:52.075182 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:52.075149 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5l9dh" Jul 06 17:52:55.579839 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:52:55.579806 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:07.112117 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:07.112081 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:07.283506 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:07.283469 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:14.377419 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:14.377379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:14.437120 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:14.437078 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:14.538785 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:14.538748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:14.594792 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:14.594749 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:17.319427 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:17.319393 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:17.417519 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:17.417486 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:49.805378 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:49.805342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:50.287841 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:50.287809 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:50.379936 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:50.379898 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:50.728510 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:50.728468 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:50.833854 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:50.833823 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:50.873559 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:53:50.873518 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:54:00.497856 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:00.497763 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:54:00.598210 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:00.598173 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:54:18.221889 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:18.221852 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:54:30.116729 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:30.116694 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:54:30.597246 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:30.597210 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:54:31.323419 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:31.323388 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:54:31.424298 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:31.424261 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:54:35.288532 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.288492 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl"] Jul 06 17:54:35.289137 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.289119 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf249e4-fcc6-4751-a102-4632982d763f" containerName="authorino" Jul 06 17:54:35.289190 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.289140 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf249e4-fcc6-4751-a102-4632982d763f" containerName="authorino" Jul 06 17:54:35.289245 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.289233 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf249e4-fcc6-4751-a102-4632982d763f" containerName="authorino" Jul 06 17:54:35.292781 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.292759 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.296211 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.296187 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kkmmc\"" Jul 06 17:54:35.296354 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.296261 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 17:54:35.296354 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.296262 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 17:54:35.297652 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.297635 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 17:54:35.303512 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.303491 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl"] Jul 06 17:54:35.321921 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.321895 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:54:35.393634 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.393606 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.393772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.393642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwzfx\" (UniqueName: \"kubernetes.io/projected/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-kube-api-access-rwzfx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.393772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.393666 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.393772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.393689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.393881 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.393768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.393881 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.393795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.494609 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.494579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.494830 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.494628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.494830 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.494649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.494830 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.494709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.494830 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.494727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzfx\" (UniqueName: \"kubernetes.io/projected/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-kube-api-access-rwzfx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.495018 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.494870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.495072 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.495019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.495072 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.495048 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.495149 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.495085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.496777 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.496756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.497125 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.497107 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.502395 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.502378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwzfx\" (UniqueName: \"kubernetes.io/projected/60f67ad4-c8bc-4155-af47-7e6ad5eec7b7-kube-api-access-rwzfx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fqhjl\" (UID: \"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.603980 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.603899 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:35.737227 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:35.737203 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl"] Jul 06 17:54:35.739076 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:54:35.739051 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f67ad4_c8bc_4155_af47_7e6ad5eec7b7.slice/crio-5ecf80a6f0c2c8ab1ef4bd7e7605d69c5e46b8d9c41ab98276c823c92dfc2ff9 WatchSource:0}: Error finding container 5ecf80a6f0c2c8ab1ef4bd7e7605d69c5e46b8d9c41ab98276c823c92dfc2ff9: Status 404 returned error can't find the container with id 5ecf80a6f0c2c8ab1ef4bd7e7605d69c5e46b8d9c41ab98276c823c92dfc2ff9 Jul 06 17:54:36.096292 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:36.096235 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:54:36.675206 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:36.675164 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" event={"ID":"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7","Type":"ContainerStarted","Data":"5ecf80a6f0c2c8ab1ef4bd7e7605d69c5e46b8d9c41ab98276c823c92dfc2ff9"} Jul 06 17:54:37.681900 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:37.681862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" event={"ID":"60f67ad4-c8bc-4155-af47-7e6ad5eec7b7","Type":"ContainerStarted","Data":"72e072f4c79376300fd265741c3c9904ceecb12d2709aa4fc435e72ec124a3f8"} Jul 06 17:54:37.700207 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:37.700151 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" podStartSLOduration=1.639745793 podStartE2EDuration="2.700138389s" totalImagesPullingTime="1.060392596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:54:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:54:37.698585162 +0000 UTC m=+845.408469714" watchObservedRunningTime="2026-07-06 17:54:37.700138389 +0000 UTC m=+845.410022974" Jul 06 17:54:45.604528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:45.604491 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:45.605039 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:45.604579 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:45.616957 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:45.616935 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:45.740685 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:45.740658 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fqhjl" Jul 06 17:54:47.629387 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:47.629353 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:54:48.598789 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:48.598750 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:54:56.624231 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:56.624200 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:54:58.494626 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:54:58.494584 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:55:13.100378 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.100341 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g"] Jul 06 17:55:13.107237 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.107216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.110275 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.110249 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 17:55:13.112314 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.112286 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g"] Jul 06 17:55:13.128569 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.128531 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:55:13.215344 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.215317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.215456 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.215350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.215456 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.215385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmcbm\" (UniqueName: \"kubernetes.io/projected/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-kube-api-access-mmcbm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.215528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.215448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.215528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.215477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.215528 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.215503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.315884 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.315852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmcbm\" (UniqueName: \"kubernetes.io/projected/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-kube-api-access-mmcbm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.316009 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.315900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.316009 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.315928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.316009 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.315950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.316178 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.316009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.316178 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.316044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.316448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.316414 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.316448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.316437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.316631 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.316509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.318230 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.318200 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.318503 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.318484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.325804 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.325784 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmcbm\" (UniqueName: \"kubernetes.io/projected/12caf2ec-bdb3-40c6-acac-daaecd6ee90d-kube-api-access-mmcbm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ds97g\" (UID: \"12caf2ec-bdb3-40c6-acac-daaecd6ee90d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.419080 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.419001 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:13.559900 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.559875 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g"] Jul 06 17:55:13.562153 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:55:13.562125 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12caf2ec_bdb3_40c6_acac_daaecd6ee90d.slice/crio-bf40b39fab9ce10eab673d5424a2c8eb43849d6c1d56a6c63f0122ddecc689b7 WatchSource:0}: Error finding container bf40b39fab9ce10eab673d5424a2c8eb43849d6c1d56a6c63f0122ddecc689b7: Status 404 returned error can't find the container with id bf40b39fab9ce10eab673d5424a2c8eb43849d6c1d56a6c63f0122ddecc689b7 Jul 06 17:55:13.877153 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.877106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" event={"ID":"12caf2ec-bdb3-40c6-acac-daaecd6ee90d","Type":"ContainerStarted","Data":"bcefc774f36805bc3d95e2781285489de3d3028d8ec7f003fe72a4b7a2cd9b2a"} Jul 06 17:55:13.877337 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.877174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" event={"ID":"12caf2ec-bdb3-40c6-acac-daaecd6ee90d","Type":"ContainerStarted","Data":"bf40b39fab9ce10eab673d5424a2c8eb43849d6c1d56a6c63f0122ddecc689b7"} Jul 06 17:55:13.894627 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:13.894575 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" podStartSLOduration=0.681205887 podStartE2EDuration="894.530598ms" totalImagesPullingTime="213.324711ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:55:13.894006522 +0000 UTC m=+881.603891074" watchObservedRunningTime="2026-07-06 17:55:13.894530598 +0000 UTC m=+881.604415130" Jul 06 17:55:14.901643 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:14.901609 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:55:21.287558 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.287521 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n"] Jul 06 17:55:21.291320 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.291294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.294355 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.294331 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 17:55:21.304198 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.304174 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n"] Jul 06 17:55:21.332063 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.332034 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:55:21.395270 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.395240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.395448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.395276 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.395448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.395363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.395448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.395386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.395448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.395406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wngh4\" (UniqueName: \"kubernetes.io/projected/c77c3b20-2974-439f-9206-64f68299f037-kube-api-access-wngh4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.395448 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.395439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c77c3b20-2974-439f-9206-64f68299f037-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.496585 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.496490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.496585 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.496530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.496585 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.496577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wngh4\" (UniqueName: \"kubernetes.io/projected/c77c3b20-2974-439f-9206-64f68299f037-kube-api-access-wngh4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.496850 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.496619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c77c3b20-2974-439f-9206-64f68299f037-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.496850 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.496676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.496850 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.496698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.497017 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.496964 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.497084 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.497025 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.497143 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.497084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.498933 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.498908 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c77c3b20-2974-439f-9206-64f68299f037-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.499205 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.499186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c77c3b20-2974-439f-9206-64f68299f037-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.504350 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.504333 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wngh4\" (UniqueName: \"kubernetes.io/projected/c77c3b20-2974-439f-9206-64f68299f037-kube-api-access-wngh4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n\" (UID: \"c77c3b20-2974-439f-9206-64f68299f037\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.603204 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.603163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:21.734441 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.734410 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n"] Jul 06 17:55:21.735943 ip-10-0-133-100 kubenswrapper[2577]: W0706 17:55:21.735915 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc77c3b20_2974_439f_9206_64f68299f037.slice/crio-dcec2d96d5cabda4d80748616e47b78422082c46a2068f1d6d49d3fa6215ad87 WatchSource:0}: Error finding container dcec2d96d5cabda4d80748616e47b78422082c46a2068f1d6d49d3fa6215ad87: Status 404 returned error can't find the container with id dcec2d96d5cabda4d80748616e47b78422082c46a2068f1d6d49d3fa6215ad87 Jul 06 17:55:21.922304 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:21.922275 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" event={"ID":"c77c3b20-2974-439f-9206-64f68299f037","Type":"ContainerStarted","Data":"dcec2d96d5cabda4d80748616e47b78422082c46a2068f1d6d49d3fa6215ad87"} Jul 06 17:55:22.929126 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:22.929089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" event={"ID":"c77c3b20-2974-439f-9206-64f68299f037","Type":"ContainerStarted","Data":"8b8f8a044d2c6e6b042277109d7207c0179dac4e83f931b2568aabb4276f9a0f"} Jul 06 17:55:22.946657 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:22.946607 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" podStartSLOduration=1.7701840770000001 podStartE2EDuration="1.946589895s" totalImagesPullingTime="176.405818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:55:22.945209157 +0000 UTC m=+890.655093713" watchObservedRunningTime="2026-07-06 17:55:22.946589895 +0000 UTC m=+890.656474447" Jul 06 17:55:23.420137 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:23.420096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:23.420344 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:23.420189 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:23.432733 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:23.432712 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:23.621703 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:23.621675 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:55:23.671175 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:23.671089 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:55:23.901449 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:23.901417 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:55:23.946063 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:23.946034 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ds97g" Jul 06 17:55:31.603466 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:31.603433 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:31.603915 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:31.603724 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:31.616112 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:31.616092 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:31.993967 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:31.993939 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n" Jul 06 17:55:45.470953 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:45.470918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:55:45.570948 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:55:45.570909 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:56:35.324531 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:56:35.324494 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:56:35.425430 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:56:35.425392 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:56:36.457203 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:56:36.457164 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:56:36.607750 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:56:36.607715 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:57:09.712873 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:57:09.712839 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:57:19.119666 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:57:19.119628 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:57:30.797533 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:57:30.797493 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:57:38.995288 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:57:38.995251 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:57:49.897263 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:57:49.897214 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:57:52.751918 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:57:52.751875 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:57:54.437479 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:57:54.437448 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:57:54.809679 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:57:54.809583 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:19.198290 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:19.198257 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:58:29.993637 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:29.993556 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:58:35.781638 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:35.781601 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:35.880985 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:35.880948 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:36.007983 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:36.007939 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:41.782383 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:41.782345 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:41.886573 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:41.886518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:41.987867 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:41.987832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:42.134952 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:42.134856 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:42.660163 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:42.660126 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:42.760344 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:42.760311 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:47.717772 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:47.717736 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:47.796658 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:58:47.796625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 17:59:03.608874 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:59:03.608841 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:59:12.094118 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:59:12.094081 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:59:22.102392 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:59:22.102357 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:59:27.796096 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:59:27.796062 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:59:38.995247 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:59:38.995208 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:59:47.895478 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:59:47.895445 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 17:59:58.997676 ip-10-0-133-100 kubenswrapper[2577]: I0706 17:59:58.997637 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:00:08.497694 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:00:08.497652 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:00:24.542318 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:00:24.542286 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:00:31.396947 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:00:31.396914 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:00:43.101944 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:00:43.101911 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:01:06.702403 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:01:06.702362 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:01:10.847612 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:01:10.847581 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:01:10.952019 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:01:10.951988 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:01:16.699435 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:01:16.699400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:01:22.902086 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:01:22.902052 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:01:34.701582 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:01:34.701480 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:01:45.902987 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:01:45.902952 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:01:55.090927 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:01:55.090889 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:02:03.497772 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:02:03.497735 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:02:11.403875 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:02:11.403837 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:02:54.502808 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:02:54.502720 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:02:54.553953 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:02:54.553920 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:04:00.906368 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:00.906336 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:04:11.594811 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:11.594777 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:04:20.705895 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:20.705857 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:04:22.697860 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:22.697825 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:04:31.494673 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:31.494588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:04:40.295885 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:40.295850 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:04:46.631243 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:46.631204 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:04:46.688980 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:46.688949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:04:47.492939 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:47.492907 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:04:51.990357 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:51.990326 2577 generic.go:356] "Generic (PLEG): container finished" podID="8fe96d64-3fb2-4052-b192-6a7dde02fc3e" containerID="de29bb1d315704b3e2c7c3dc138a4e3eb4bf5394b56bf2df30331e935d1d8041" exitCode=1 Jul 06 18:04:51.990960 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:51.990401 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" event={"ID":"8fe96d64-3fb2-4052-b192-6a7dde02fc3e","Type":"ContainerDied","Data":"de29bb1d315704b3e2c7c3dc138a4e3eb4bf5394b56bf2df30331e935d1d8041"} Jul 06 18:04:51.990960 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:51.990792 2577 scope.go:117] "RemoveContainer" containerID="de29bb1d315704b3e2c7c3dc138a4e3eb4bf5394b56bf2df30331e935d1d8041" Jul 06 18:04:52.997478 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:52.997439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jbzc" event={"ID":"8fe96d64-3fb2-4052-b192-6a7dde02fc3e","Type":"ContainerStarted","Data":"420f36b8de4a736d63efd020265f09a908c6783874d3f99a74c106624ac2e551"} Jul 06 18:04:56.202543 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:04:56.202508 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:05:05.890972 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:05:05.890937 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:05:15.999437 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:05:15.999400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:05:25.801349 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:05:25.801313 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:05:33.595472 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:05:33.595434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:05:42.294475 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:05:42.294444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:05:48.198657 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:05:48.198626 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:06:11.107014 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:06:11.106980 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:06:19.696930 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:06:19.696898 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:06:29.702271 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:06:29.702235 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:06:42.594407 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:06:42.594376 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:06:58.193955 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:06:58.193919 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:07:07.603585 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:07:07.603533 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:07:17.295699 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:07:17.295664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:07:25.403657 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:07:25.403575 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:07:35.499125 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:07:35.499087 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:07:45.106295 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:07:45.106260 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:07:53.860866 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:07:53.860832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:54.790286 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:07:54.790241 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:07:55.088123 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:07:55.088035 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:07.797947 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:08:07.797910 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:08:17.300300 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:08:17.300265 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:08:26.900158 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:08:26.900120 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:08:36.698025 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:08:36.697985 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:08:48.195025 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:08:48.194985 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:08:54.988865 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:08:54.988791 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:09:04.492209 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:09:04.492172 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:09:12.595612 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:09:12.595575 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:09:25.090723 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:09:25.090682 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:09:36.697597 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:09:36.697561 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:09:39.688760 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:09:39.688725 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:46.196324 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:09:46.196286 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:09:49.475990 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:09:49.475952 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:57.730044 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:09:57.730006 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:02.836204 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:02.836123 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:05.618276 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:05.618233 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:05.680808 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:05.680770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:05.838344 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:05.838309 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:06.036762 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:06.036720 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:06.694130 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:06.694096 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:10:11.662574 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:11.662518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:11.764878 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:11.764844 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:11.863665 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:11.863635 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:11.966588 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:11.966537 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:12.961386 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:12.961351 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:13.043235 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:13.043198 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:13.188595 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:13.188565 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:13.281225 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:13.281134 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:13.543974 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:13.543886 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:13.644437 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:13.644407 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:16.198136 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:16.198100 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:10:16.517921 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:16.517889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:18.094929 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:18.094893 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:18.318134 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:18.318094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:18.424010 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:18.423918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:18.510325 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:18.510294 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:20.306371 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:20.306341 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:24.262000 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:24.261966 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:24.365004 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:24.364968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:24.490627 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:24.490589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:24.599903 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:24.599811 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:25.596713 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:25.596679 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:25.681157 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:25.681053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:25.752994 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:25.752957 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:25.882856 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:25.882770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:26.277911 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:26.277865 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:26.380836 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:26.380805 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:26.495731 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:26.495700 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:10:27.788688 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:27.788660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:35.592041 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:35.592007 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:35.905528 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:35.905436 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:10:35.997050 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:35.997020 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:39.698926 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:39.698895 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:40.211289 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:40.211240 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:41.687938 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:41.687900 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:43.433204 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:43.433172 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:43.606157 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:43.606112 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:10:51.795736 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:51.795701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:57.684169 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:57.684132 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:57.740576 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:57.740528 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:58.998727 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:58.998691 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:59.102239 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:59.102206 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:59.244056 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:59.244024 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:59.463505 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:59.463470 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:59.649705 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:59.649673 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:59.753655 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:10:59.753572 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:01.800747 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:01.800713 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:11:03.440178 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:03.440142 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:03.719079 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:03.718993 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:03.780052 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:03.780023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:09.491099 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:09.491064 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:09.596198 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:09.596160 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:09.983404 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:09.983353 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:10.081746 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:10.081702 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:10.182957 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:10.182920 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:10.996561 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:10.996522 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:11:11.584105 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:11.584066 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:17.385559 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:17.385505 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:17.495223 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:17.495172 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:17.586281 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:17.586243 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:17.685947 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:17.685913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:18.073460 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:18.073372 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:44.035373 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:44.035338 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:49.851617 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:49.851579 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:49.910519 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:49.910479 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:49.997891 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:49.997860 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:50.099184 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:11:50.099148 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:05.946162 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:05.946127 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:11.644709 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:11.644668 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:11.705944 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:11.705912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:11.783801 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:11.783765 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:11.920012 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:11.919927 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:22.395166 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:22.395121 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:23.180112 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:23.180077 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:28.824923 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:28.824892 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:28.893596 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:28.893535 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:28.975161 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:28.975123 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:29.068256 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:29.068223 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:29.181724 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:29.181638 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:29.916928 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:29.916894 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:30.012125 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:30.012084 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:30.109838 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:30.109803 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:31.676570 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:31.676517 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:32.397129 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:32.397093 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:12:37.201444 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:37.201411 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:37.254707 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:37.254680 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:37.891173 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:37.891140 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:38.333890 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:38.333852 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:40.398291 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:40.398253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:12:43.423290 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:43.423252 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:43.523078 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:43.523046 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:43.692414 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:43.692380 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:43.965053 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:43.964972 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:45.094522 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:45.094487 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:47.370435 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:47.370395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:47.465834 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:47.465802 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:47.531139 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:47.531104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:47.776736 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:47.776693 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:48.003887 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:48.003852 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:48.103909 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:48.103819 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:51.866056 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:51.866013 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:52.518356 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:52.518318 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:52.612168 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:52.612138 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:52.952387 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:52.952358 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:54.698379 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:54.698345 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:12:58.663176 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:58.663144 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:59.823159 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:12:59.823115 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:03.388903 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:03.388868 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:13:05.225626 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:05.225591 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:05.281301 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:05.281253 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:05.474933 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:05.474879 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:05.698199 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:05.698157 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:05.812257 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:05.812222 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:05.912056 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:05.912021 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:06.024096 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:06.023993 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:11.808555 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:11.808523 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:11.866077 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:11.866046 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:11.975510 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:11.975471 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:12.109460 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:12.109366 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:12.207819 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:12.207786 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:17.511561 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:17.511506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:17.613966 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:17.613929 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:18.251274 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:18.251239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:18.317026 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:18.316987 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:25.025186 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:25.025099 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:25.337233 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:25.337150 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:26.435275 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:26.435237 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:28.562629 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:28.562577 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:28.642826 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:28.642789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:28.799211 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:28.799173 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:29.130765 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:29.130727 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:29.321451 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:29.321416 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:29.424124 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:29.424037 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:33.071359 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:33.071327 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:34.396471 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:13:34.396436 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:14:03.241950 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:14:03.241921 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:14:06.099633 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:14:06.099598 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:14:17.701374 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:14:17.701338 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:14:20.775361 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:14:20.775323 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:14:21.121256 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:14:21.121176 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:14:26.868285 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:14:26.868239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:14:31.888580 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:14:31.888524 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:14:31.994807 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:14:31.994774 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:15:00.660756 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:00.660668 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:01.200606 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:01.200572 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:03.794169 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:03.794132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:15:06.613719 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:06.613688 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:06.713791 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:06.713738 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:06.884934 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:06.884836 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:07.110677 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:07.110641 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:17.934429 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:17.934394 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:18.024868 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:18.024832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:18.123989 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:18.123941 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:28.959917 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:28.959872 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:34.482314 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:34.482282 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:34.540396 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:34.540365 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:35.097497 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:35.097467 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:35.193349 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:35.193315 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:45.670335 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:45.670285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:46.020534 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:15:46.020500 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:06.987800 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:06.987761 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:12.529334 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:12.529299 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:12.588008 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:12.587972 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:12.875232 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:12.875115 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:13.472371 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:13.472328 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:13.525344 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:13.525307 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:16.446327 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:16.446298 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:16.540484 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:16.540433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:16.604110 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:16.604069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:16.703651 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:16.703535 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:17.013066 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:17.012974 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:17.118051 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:17.118014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:20.862752 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:20.862713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:21.199827 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:21.199789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:21.489405 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:21.489325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:21.599707 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:21.599678 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:24.297580 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:24.297533 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:16:24.469257 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:24.469180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:24.563271 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:24.563184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:24.792195 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:24.792164 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:24.897148 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:24.897065 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:25.235129 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:25.235097 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:25.340976 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:25.340945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:28.958088 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:28.958036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:35.797128 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:35.797084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:16:37.710933 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:37.710897 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:37.811950 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:37.811916 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:41.128339 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:41.128310 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:43.700488 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:43.700450 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:16:46.630287 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:46.630248 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:46.796497 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:46.796463 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:57.096798 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:16:57.096759 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:17:02.416938 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:02.416903 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:08.201057 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:08.201004 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:17:20.993507 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:20.993470 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:17:22.494513 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:22.494480 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:23.489338 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:23.489308 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:23.643950 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:23.643913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:24.045716 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:24.045682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:24.145651 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:24.145617 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:24.325506 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:24.325420 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:29.123030 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:29.122998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:35.990068 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:35.990029 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:17:53.670140 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:53.670100 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:53.770583 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:17:53.770532 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:05.790368 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:05.790330 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:07.256863 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:07.256804 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:12.575335 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:12.575302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:12.602268 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:12.602237 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:18:12.676072 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:12.676039 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:12.826816 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:12.826731 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:13.071049 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:13.071017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:13.394589 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:13.394535 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:13.690862 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:13.690832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:14.004015 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:14.003926 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:16.953350 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:16.953311 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:17.054244 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:17.054212 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:17.132095 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:17.132065 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:17.444258 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:17.444225 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:17.838022 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:17.837941 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:17.938387 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:17.938357 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:18.812410 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:18.812376 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:18.915002 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:18.914973 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:19.689290 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:19.689260 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:19.789587 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:19.789540 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:21.457683 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:21.457654 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:21.889137 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:21.889012 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:22.192478 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:22.192434 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:22.292198 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:22.292166 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:24.092921 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:24.092883 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:18:25.080948 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:25.080916 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:25.161782 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:25.161748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:25.229290 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:25.229258 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:25.329523 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:25.329493 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:25.478722 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:25.478689 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:25.740867 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:25.740791 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:25.845785 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:25.845748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:29.486646 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:29.486605 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:37.504107 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:37.504064 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:37.611392 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:37.611357 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:37.712172 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:37.712139 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:37.898143 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:37.898067 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:37.998355 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:37.998320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:38.098746 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:38.098714 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:38.169353 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:38.169275 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:40.694657 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:40.694621 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:18:43.532778 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:43.532743 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:43.594390 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:43.594359 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:43.793088 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:43.793002 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:44.029735 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:44.029708 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:44.188268 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:44.188232 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:44.582167 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:44.582069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:44.680056 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:44.680008 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:44.780125 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:44.780094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:44.889278 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:44.889192 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:50.294813 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:50.294786 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:50.395145 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:50.395116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:50.549721 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:50.549644 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:50.774653 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:50.774620 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:51.106255 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:51.106219 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:51.391656 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:51.391542 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:51.915691 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:51.915659 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:54.137506 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:54.137469 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:54.220390 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:54.220349 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:54.390143 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:54.390057 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:54.475611 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:54.475572 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:54.609450 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:54.609412 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:18:54.825162 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:54.825132 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:54.929422 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:54.929392 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:58.625033 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:58.625000 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:58.938272 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:58.938240 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:59.218396 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:59.218320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:59.970185 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:18:59.970155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:02.176652 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:02.176616 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:02.271350 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:02.271314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:02.338648 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:02.338621 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:02.634183 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:02.634156 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:02.866381 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:02.866349 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:02.965925 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:02.965890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:06.667097 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:06.667045 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:08.424522 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:08.424465 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:08.504859 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:08.504828 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:19:16.408141 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:16.408101 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:16.509391 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:16.509355 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:18.289179 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:18.289144 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:19:23.592056 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:23.592019 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:23.692321 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:23.692287 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:32.957754 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:32.957675 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:36.823152 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:36.823110 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:40.896700 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:40.896666 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:19:43.697153 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:43.697117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:54.453648 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:19:54.453616 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:20:13.791483 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:20:13.791444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:20:31.697078 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:20:31.697026 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:20:47.700300 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:20:47.700270 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:21:03.994639 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:21:03.994596 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:21:21.191643 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:21:21.191578 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:21:32.724791 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:21:32.724749 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:21:33.740781 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:21:33.740744 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:21:35.794050 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:21:35.794021 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:21:50.131675 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:21:50.131617 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:21:50.693584 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:21:50.693535 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:22:02.193740 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:22:02.193700 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:22:10.899051 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:22:10.899012 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:22:17.404015 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:22:17.403978 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:22:32.199610 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:22:32.199519 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:22:47.189793 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:22:47.189757 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:22:48.114670 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:22:48.114636 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:22:51.904847 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:22:51.904815 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:23:09.391872 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:23:09.391822 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:23:13.192242 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:23:13.192198 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:23:19.789476 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:23:19.789431 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:23:19.894125 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:23:19.894096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:23:34.715345 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:23:34.715315 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:23:39.004395 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:23:39.004361 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:24:11.000811 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:11.000777 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:24:17.090776 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:17.090744 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:17.191878 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:17.191846 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:24.383251 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:24.383218 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:24.484216 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:24.484184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:25.498080 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:25.498046 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:24:32.496106 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:32.496076 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:33.414095 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:33.414059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:34.459816 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:34.459779 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:34.830896 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:34.830798 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:34.929417 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:34.929381 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:35.030807 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:35.030775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:35.130667 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:35.130542 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:24:38.590886 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:38.590847 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:24:39.907344 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:24:39.907312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:00.802775 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:00.802739 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:01.051012 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:01.050982 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:01.343185 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:01.343154 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:01.478899 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:01.478869 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:01.880098 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:01.880058 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:01.977222 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:01.977180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:02.133114 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:02.133022 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:02.666049 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:02.666021 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:02.723961 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:02.723935 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:05.292500 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:05.292463 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5l9dh"] Jul 06 18:25:07.700359 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:07.700325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:07.804097 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:07.804068 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:07.954829 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:07.954752 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:08.170105 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:08.170074 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:14.305889 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:14.305861 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74668f54-w8f8l_4228fc90-b006-426b-8102-15ff7f8c5b74/copy-manifests/0.log" Jul 06 18:25:14.318598 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:14.318572 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74668f54-w8f8l_4228fc90-b006-426b-8102-15ff7f8c5b74/manager/0.log" Jul 06 18:25:15.198603 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.198574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2_df645b46-4ccf-4cee-b9f3-e031d5633094/extract/0.log" Jul 06 18:25:15.205024 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.205003 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2_df645b46-4ccf-4cee-b9f3-e031d5633094/util/0.log" Jul 06 18:25:15.211215 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.211201 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2_df645b46-4ccf-4cee-b9f3-e031d5633094/pull/0.log" Jul 06 18:25:15.323698 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.323673 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt_f57ab857-acaa-4eb1-8d31-f64baee7cf02/extract/0.log" Jul 06 18:25:15.330211 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.330187 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt_f57ab857-acaa-4eb1-8d31-f64baee7cf02/util/0.log" Jul 06 18:25:15.336684 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.336666 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt_f57ab857-acaa-4eb1-8d31-f64baee7cf02/pull/0.log" Jul 06 18:25:15.448846 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.448774 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q_3b326c3d-18e3-4943-942a-f6ebd8daea66/util/0.log" Jul 06 18:25:15.455587 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.455566 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q_3b326c3d-18e3-4943-942a-f6ebd8daea66/pull/0.log" Jul 06 18:25:15.462363 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.462343 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q_3b326c3d-18e3-4943-942a-f6ebd8daea66/extract/0.log" Jul 06 18:25:15.565370 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.565342 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn_f295aafd-046c-43ce-8b61-c11da6c0fa16/pull/0.log" Jul 06 18:25:15.572097 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.572076 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn_f295aafd-046c-43ce-8b61-c11da6c0fa16/extract/0.log" Jul 06 18:25:15.578324 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:15.578301 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn_f295aafd-046c-43ce-8b61-c11da6c0fa16/util/0.log" Jul 06 18:25:16.058858 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:16.058827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cbqxb_efe79272-6bbb-40b5-b562-606acb0e46fc/kuadrant-console-plugin/0.log" Jul 06 18:25:16.368500 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:16.368408 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:16.417819 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:16.417793 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5l9dh_47986f40-e498-49c1-b77b-4257cc7761d8/limitador/0.log" Jul 06 18:25:17.102067 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:17.102041 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98dc6956-bzjw6_ac1fb607-3ee2-4532-b0bb-71d260f56eed/kube-auth-proxy/0.log" Jul 06 18:25:18.132154 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:18.132115 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fqhjl_60f67ad4-c8bc-4155-af47-7e6ad5eec7b7/main/0.log" Jul 06 18:25:18.470670 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:18.470642 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ds97g_12caf2ec-bdb3-40c6-acac-daaecd6ee90d/main/0.log" Jul 06 18:25:18.585432 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:18.585387 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-rjm6n_c77c3b20-2974-439f-9206-64f68299f037/main/0.log" Jul 06 18:25:22.922404 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:22.922369 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:22.982534 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:22.982499 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:25.827915 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:25.827835 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z7cwn_3929d7f2-43e4-4cd4-97cc-f6fe9964c5dc/global-pull-secret-syncer/0.log" Jul 06 18:25:25.875352 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:25.875320 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" Jul 06 18:25:25.978287 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:25.978255 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-100.ec2.internal_d9530b52cc90d833d2a92ae3eb83d4cd/haproxy/0.log" Jul 06 18:25:30.777690 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:30.777651 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2_df645b46-4ccf-4cee-b9f3-e031d5633094/extract/0.log" Jul 06 18:25:30.804651 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:30.804627 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2_df645b46-4ccf-4cee-b9f3-e031d5633094/util/0.log" Jul 06 18:25:30.831247 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:30.831220 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dfjn2_df645b46-4ccf-4cee-b9f3-e031d5633094/pull/0.log" Jul 06 18:25:30.865469 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:30.865442 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt_f57ab857-acaa-4eb1-8d31-f64baee7cf02/extract/0.log" Jul 06 18:25:30.891245 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:30.891218 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt_f57ab857-acaa-4eb1-8d31-f64baee7cf02/util/0.log" Jul 06 18:25:30.916456 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:30.916425 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06gjjt_f57ab857-acaa-4eb1-8d31-f64baee7cf02/pull/0.log" Jul 06 18:25:30.945539 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:30.945510 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q_3b326c3d-18e3-4943-942a-f6ebd8daea66/extract/0.log" Jul 06 18:25:30.973168 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:30.973143 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q_3b326c3d-18e3-4943-942a-f6ebd8daea66/util/0.log" Jul 06 18:25:30.997436 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:30.997412 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fvk9q_3b326c3d-18e3-4943-942a-f6ebd8daea66/pull/0.log" Jul 06 18:25:31.029348 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:31.029269 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn_f295aafd-046c-43ce-8b61-c11da6c0fa16/extract/0.log" Jul 06 18:25:31.060982 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:31.060961 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn_f295aafd-046c-43ce-8b61-c11da6c0fa16/util/0.log" Jul 06 18:25:31.083947 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:31.083928 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16k5cn_f295aafd-046c-43ce-8b61-c11da6c0fa16/pull/0.log" Jul 06 18:25:31.699205 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:31.699175 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cbqxb_efe79272-6bbb-40b5-b562-606acb0e46fc/kuadrant-console-plugin/0.log" Jul 06 18:25:31.931706 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:31.931683 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5l9dh_47986f40-e498-49c1-b77b-4257cc7761d8/limitador/0.log" Jul 06 18:25:33.713062 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:33.713040 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1dd8c-fe42-44d1-8660-a50bd34a18e7/alertmanager/0.log" Jul 06 18:25:33.754056 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:33.754027 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1dd8c-fe42-44d1-8660-a50bd34a18e7/config-reloader/0.log" Jul 06 18:25:33.780071 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:33.780047 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1dd8c-fe42-44d1-8660-a50bd34a18e7/kube-rbac-proxy-web/0.log" Jul 06 18:25:33.809462 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:33.809443 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1dd8c-fe42-44d1-8660-a50bd34a18e7/kube-rbac-proxy/0.log" Jul 06 18:25:33.838232 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:33.838202 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1dd8c-fe42-44d1-8660-a50bd34a18e7/kube-rbac-proxy-metric/0.log" Jul 06 18:25:33.864097 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:33.864078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1dd8c-fe42-44d1-8660-a50bd34a18e7/prom-label-proxy/0.log" Jul 06 18:25:33.891308 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:33.891287 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ea1dd8c-fe42-44d1-8660-a50bd34a18e7/init-config-reloader/0.log" Jul 06 18:25:33.973455 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:33.973366 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-68mkf_03222d6b-02a9-4ad3-ab5c-30f69ab1af5d/kube-state-metrics/0.log" Jul 06 18:25:33.998407 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:33.998379 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-68mkf_03222d6b-02a9-4ad3-ab5c-30f69ab1af5d/kube-rbac-proxy-main/0.log" Jul 06 18:25:34.022104 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.022071 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-68mkf_03222d6b-02a9-4ad3-ab5c-30f69ab1af5d/kube-rbac-proxy-self/0.log" Jul 06 18:25:34.063438 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.063414 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64b848bcd9-zcxf5_267f4217-dcf3-4c4a-b6c5-afbe2ff6aebd/metrics-server/0.log" Jul 06 18:25:34.091608 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.091578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-l28ph_075a5193-263e-4d8d-bbd8-2d3e5ea2059f/monitoring-plugin/0.log" Jul 06 18:25:34.210658 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.210627 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dbt2w_174d2424-309a-4ea7-85d4-15db385fedf8/node-exporter/0.log" Jul 06 18:25:34.236096 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.236022 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dbt2w_174d2424-309a-4ea7-85d4-15db385fedf8/kube-rbac-proxy/0.log" Jul 06 18:25:34.259781 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.259757 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dbt2w_174d2424-309a-4ea7-85d4-15db385fedf8/init-textfile/0.log" Jul 06 18:25:34.367380 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.367351 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-8vjj5_d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b/kube-rbac-proxy-main/0.log" Jul 06 18:25:34.390567 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.390534 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-8vjj5_d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b/kube-rbac-proxy-self/0.log" Jul 06 18:25:34.414749 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.414729 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-8vjj5_d196fbff-e6ac-410d-bbf0-9fd2bfaddc0b/openshift-state-metrics/0.log" Jul 06 18:25:34.689212 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.689189 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-66wf4_2cfe1659-e7a2-4254-89f9-fec80864cf39/prometheus-operator-admission-webhook/0.log" Jul 06 18:25:34.723390 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.723365 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c94bcc458-jpt4f_d1f1b903-5e33-42f1-a576-1d9d9e5b1c23/telemeter-client/0.log" Jul 06 18:25:34.750031 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.750004 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c94bcc458-jpt4f_d1f1b903-5e33-42f1-a576-1d9d9e5b1c23/reload/0.log" Jul 06 18:25:34.772985 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.772958 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c94bcc458-jpt4f_d1f1b903-5e33-42f1-a576-1d9d9e5b1c23/kube-rbac-proxy/0.log" Jul 06 18:25:34.802415 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.802391 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847879ff66-fp6ld_665cda69-52f1-4427-b71e-e2190b381a24/thanos-query/0.log" Jul 06 18:25:34.825924 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.825895 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847879ff66-fp6ld_665cda69-52f1-4427-b71e-e2190b381a24/kube-rbac-proxy-web/0.log" Jul 06 18:25:34.850218 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.850194 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847879ff66-fp6ld_665cda69-52f1-4427-b71e-e2190b381a24/kube-rbac-proxy/0.log" Jul 06 18:25:34.881889 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.881865 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847879ff66-fp6ld_665cda69-52f1-4427-b71e-e2190b381a24/prom-label-proxy/0.log" Jul 06 18:25:34.907934 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.907909 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847879ff66-fp6ld_665cda69-52f1-4427-b71e-e2190b381a24/kube-rbac-proxy-rules/0.log" Jul 06 18:25:34.932303 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:34.932278 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847879ff66-fp6ld_665cda69-52f1-4427-b71e-e2190b381a24/kube-rbac-proxy-metrics/0.log" Jul 06 18:25:36.406714 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.406678 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn"] Jul 06 18:25:36.410613 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.410595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.414924 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.414901 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q4mx2\"/\"openshift-service-ca.crt\"" Jul 06 18:25:36.414924 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.414922 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q4mx2\"/\"kube-root-ca.crt\"" Jul 06 18:25:36.415108 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.414923 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q4mx2\"/\"default-dockercfg-qlwpk\"" Jul 06 18:25:36.416933 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.416907 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn"] Jul 06 18:25:36.450792 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.450762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-lib-modules\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.450792 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.450788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-podres\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.451035 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.450835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-proc\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.451035 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.450914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbk9d\" (UniqueName: \"kubernetes.io/projected/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-kube-api-access-gbk9d\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.451035 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.450977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-sys\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.551647 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.551614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbk9d\" (UniqueName: \"kubernetes.io/projected/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-kube-api-access-gbk9d\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.551839 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.551658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-sys\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.551839 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.551690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-lib-modules\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.551839 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.551705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-podres\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.551839 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.551757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-proc\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.551839 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.551764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-sys\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.551839 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.551832 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-proc\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.552054 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.551835 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-lib-modules\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.552054 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.551890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-podres\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.559583 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.559543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbk9d\" (UniqueName: \"kubernetes.io/projected/e6586ba8-1abd-4391-b0c6-a2172c3cdeca-kube-api-access-gbk9d\") pod \"perf-node-gather-daemonset-lqzhn\" (UID: \"e6586ba8-1abd-4391-b0c6-a2172c3cdeca\") " pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.721816 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.721785 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:36.859487 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:36.859462 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn"] Jul 06 18:25:36.861879 ip-10-0-133-100 kubenswrapper[2577]: W0706 18:25:36.861854 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode6586ba8_1abd_4391_b0c6_a2172c3cdeca.slice/crio-06459214ff99cedb528281331f135477ca691eb3d55d63782c9f9ac71b37377f WatchSource:0}: Error finding container 06459214ff99cedb528281331f135477ca691eb3d55d63782c9f9ac71b37377f: Status 404 returned error can't find the container with id 06459214ff99cedb528281331f135477ca691eb3d55d63782c9f9ac71b37377f Jul 06 18:25:37.785695 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:37.785653 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" event={"ID":"e6586ba8-1abd-4391-b0c6-a2172c3cdeca","Type":"ContainerStarted","Data":"fd6531b731f9e07e675831e4fc938e97a474e5113bc51602a72a74abb97774b6"} Jul 06 18:25:37.786080 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:37.785711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" event={"ID":"e6586ba8-1abd-4391-b0c6-a2172c3cdeca","Type":"ContainerStarted","Data":"06459214ff99cedb528281331f135477ca691eb3d55d63782c9f9ac71b37377f"} Jul 06 18:25:37.786080 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:37.785748 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:37.802534 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:37.802488 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" podStartSLOduration=1.802475089 podStartE2EDuration="1.802475089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:25:37.800777047 +0000 UTC m=+2705.510661620" watchObservedRunningTime="2026-07-06 18:25:37.802475089 +0000 UTC m=+2705.512359639" Jul 06 18:25:39.081326 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:39.081299 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rv48c_6a0420eb-1489-4a4e-9dfd-a29b793f797e/dns/0.log" Jul 06 18:25:39.105811 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:39.105790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rv48c_6a0420eb-1489-4a4e-9dfd-a29b793f797e/kube-rbac-proxy/0.log" Jul 06 18:25:39.134328 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:39.134305 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rkqhf_e85ae0f7-be74-4213-a011-2ca424f86604/dns-node-resolver/0.log" Jul 06 18:25:39.785772 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:39.785749 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6kpx2_519470ee-d1c3-4103-9d2f-a0930c92c9d8/node-ca/0.log" Jul 06 18:25:40.970944 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:40.970911 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98dc6956-bzjw6_ac1fb607-3ee2-4532-b0bb-71d260f56eed/kube-auth-proxy/0.log" Jul 06 18:25:41.797329 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:41.797299 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgkx2_d37167cf-1773-4b70-a0cd-7b1f84c45439/konnectivity-agent/0.log" limit=1024 Jul 06 18:25:41.959465 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:41.959430 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x6vm5_e2494827-dc7f-402b-bf10-aae6a568d847/serve-healthcheck-canary/0.log" Jul 06 18:25:42.649815 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:42.649778 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jddpc_687c16e7-c239-44bb-ac04-8ae4c183f52a/kube-rbac-proxy/0.log" Jul 06 18:25:42.673908 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:42.673881 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jddpc_687c16e7-c239-44bb-ac04-8ae4c183f52a/exporter/0.log" Jul 06 18:25:42.697742 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:42.697719 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jddpc_687c16e7-c239-44bb-ac04-8ae4c183f52a/extractor/0.log" Jul 06 18:25:43.802048 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:43.802021 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q4mx2/perf-node-gather-daemonset-lqzhn" Jul 06 18:25:45.687788 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:45.687760 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74668f54-w8f8l_4228fc90-b006-426b-8102-15ff7f8c5b74/manager/0.log" Jul 06 18:25:45.706710 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:45.706685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74668f54-w8f8l_4228fc90-b006-426b-8102-15ff7f8c5b74/copy-manifests/0.log" Jul 06 18:25:47.206474 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:47.206425 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7768b55bcf-c54bn_1b75a7dc-fea8-44b7-802f-f3841646e28d/manager/0.log" Jul 06 18:25:47.843593 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:47.843568 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98dc6956-bzjw6_ac1fb607-3ee2-4532-b0bb-71d260f56eed/kube-auth-proxy/0.log" Jul 06 18:25:49.449142 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:49.449110 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98dc6956-bzjw6_ac1fb607-3ee2-4532-b0bb-71d260f56eed/kube-auth-proxy/0.log" Jul 06 18:25:52.400260 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:52.400233 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-vw79d_a029e0e1-0bfe-4b61-bacb-c534d428b6a6/migrator/0.log" Jul 06 18:25:52.422995 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:52.422968 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-vw79d_a029e0e1-0bfe-4b61-bacb-c534d428b6a6/graceful-termination/0.log" Jul 06 18:25:52.786668 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:52.786640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-lf2pj_3a23d1e9-e687-4bab-8ec5-a753fd1b7b48/kube-storage-version-migrator-operator/1.log" Jul 06 18:25:52.787124 ip-10-0-133-100 kubenswrapper[2577]: I0706 18:25:52.787105 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-lf2pj_3a23d1e9-e687-4bab-8ec5-a753fd1b7b48/kube-storage-version-migrator-operator/0.log"