Jun 08 19:30:48.159600 ip-10-0-133-234 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 19:30:48.159612 ip-10-0-133-234 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 19:30:48.159622 ip-10-0-133-234 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 19:30:48.159939 ip-10-0-133-234 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 19:30:58.161701 ip-10-0-133-234 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 19:30:58.161720 ip-10-0-133-234 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 69bdc14cd2a9410896b3bdeeb72874df -- Jun 08 19:33:33.315831 ip-10-0-133-234 systemd[1]: Starting Kubernetes Kubelet... Jun 08 19:33:33.753066 ip-10-0-133-234 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:33:33.753066 ip-10-0-133-234 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 19:33:33.753066 ip-10-0-133-234 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:33:33.753066 ip-10-0-133-234 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 19:33:33.753066 ip-10-0-133-234 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 19:33:33.755077 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.754989 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 19:33:33.759453 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759419 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:33.759453 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759451 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:33.759453 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759457 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759461 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759466 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759471 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759475 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759480 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759484 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759488 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759493 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759497 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759501 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759505 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759508 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759513 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759517 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759521 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759525 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759529 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759533 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759537 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:33.759644 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759541 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759545 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759549 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759553 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759557 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759561 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759566 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759570 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759575 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759582 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759588 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759593 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759598 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759603 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759607 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759612 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759616 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759620 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759625 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759630 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:33.760467 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759634 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759640 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759644 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759648 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759652 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759656 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759661 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759665 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759669 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759673 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759679 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759684 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759688 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759695 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759701 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759705 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759709 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759714 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759719 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:33.761287 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759723 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759727 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759732 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759737 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759742 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759746 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759750 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759754 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759758 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759762 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759767 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759771 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759776 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759780 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759784 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759792 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759797 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759802 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759807 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759814 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:33.762054 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759819 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759823 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759827 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759831 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759835 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759841 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759845 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759849 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759853 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759858 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759862 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759867 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759871 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759876 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759880 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759885 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759890 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.759894 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761107 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761116 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:33.762611 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761122 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761126 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761131 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761136 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761140 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761145 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761149 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761153 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761168 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761173 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761178 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761182 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761187 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761191 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761196 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761200 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761206 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761214 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761218 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:33.763101 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761223 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761227 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761231 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761236 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761241 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761245 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761251 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761255 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761259 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761263 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761268 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761272 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761276 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761280 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761284 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761288 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761292 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761296 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761300 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761304 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:33.763623 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761308 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761312 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761318 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761322 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761327 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761331 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761335 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761340 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761344 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761349 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761353 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761357 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761362 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761366 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761370 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761375 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761379 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761384 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761388 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761392 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:33.764389 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761396 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761401 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761405 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761409 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761414 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761418 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761422 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761443 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761447 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761451 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761455 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761459 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761464 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761468 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761472 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761477 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761482 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761489 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761494 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761499 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:33.764967 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761503 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761508 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761512 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761519 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761525 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761530 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761536 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761541 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761545 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761549 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761556 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761562 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761566 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761571 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761576 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761580 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761585 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.761589 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762195 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:33.765539 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762207 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762210 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762214 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762218 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762221 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762226 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762229 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762233 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762236 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762239 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762241 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762244 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762247 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762250 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762253 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762255 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762258 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762260 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762263 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:33.766077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762266 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762269 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762272 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762274 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762277 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762280 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762282 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762285 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762287 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762290 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762292 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762294 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762297 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762301 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762304 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762307 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762309 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762312 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762314 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762317 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:33.766567 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762320 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762322 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762325 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762328 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762330 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762333 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762335 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762338 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762340 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762344 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762347 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762349 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762352 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762354 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762358 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762361 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762366 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762369 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762372 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762374 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:33.767064 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762377 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762380 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762382 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762385 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762388 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762394 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762397 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762400 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762403 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762405 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762408 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762411 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762414 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762416 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762419 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762421 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762424 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762438 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762441 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762444 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:33.767574 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762446 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762449 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762453 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762458 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762462 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762464 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762467 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762470 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762473 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762475 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762478 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762480 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762484 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762486 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762489 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762492 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762494 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762499 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.762501 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762572 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 19:33:33.768131 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762579 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762587 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762591 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762596 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762599 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762620 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762625 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762629 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762632 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762635 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762639 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762642 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762645 2562 flags.go:64] FLAG: --cgroup-root="" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762649 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762652 2562 flags.go:64] FLAG: --client-ca-file="" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762655 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762658 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762662 2562 flags.go:64] FLAG: --cluster-domain="" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762665 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762669 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762672 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762675 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762679 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 19:33:33.768634 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762682 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762686 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762689 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762692 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762695 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762698 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762702 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762706 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762710 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762715 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762718 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762721 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762724 2562 flags.go:64] FLAG: --enable-server="true" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762727 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762732 2562 flags.go:64] FLAG: --event-burst="100" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762735 2562 flags.go:64] FLAG: --event-qps="50" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762738 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762741 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762744 2562 flags.go:64] FLAG: --eviction-hard="" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762748 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762751 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762754 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762757 2562 flags.go:64] FLAG: --eviction-soft="" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762760 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762763 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 19:33:33.769188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762766 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762769 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762773 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762776 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762778 2562 flags.go:64] FLAG: --feature-gates="" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762782 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762785 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762788 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762791 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762795 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762798 2562 flags.go:64] FLAG: --help="false" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762801 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-133-234.ec2.internal" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762804 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762808 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762810 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762814 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762817 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762821 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762824 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762827 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762830 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762833 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762836 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762839 2562 flags.go:64] FLAG: --kube-reserved="" Jun 08 19:33:33.769839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762842 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762845 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762848 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762851 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762854 2562 flags.go:64] FLAG: --lock-file="" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762857 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762859 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762862 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762868 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762871 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762874 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762878 2562 flags.go:64] FLAG: --logging-format="text" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762880 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762884 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762887 2562 flags.go:64] FLAG: --manifest-url="" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762890 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762894 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762897 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762902 2562 flags.go:64] FLAG: --max-pods="110" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762905 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762908 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762911 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762914 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762917 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762920 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 19:33:33.770455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762924 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762936 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762940 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762943 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762946 2562 flags.go:64] FLAG: --pod-cidr="" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762949 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762955 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762958 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762961 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762964 2562 flags.go:64] FLAG: --port="10250" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762967 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762970 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09c6b7a8bff4d40b5" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762973 2562 flags.go:64] FLAG: --qos-reserved="" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762976 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762979 2562 flags.go:64] FLAG: --register-node="true" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762982 2562 flags.go:64] FLAG: --register-with-taints="" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762986 2562 flags.go:64] FLAG: --registry-burst="10" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762989 2562 flags.go:64] FLAG: --registry-qps="5" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762992 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762995 2562 flags.go:64] FLAG: --reserved-memory="" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.762999 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763002 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763005 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763008 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763011 2562 flags.go:64] FLAG: --runonce="false" Jun 08 19:33:33.771100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763014 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763017 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763020 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763023 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763026 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763029 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763032 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763035 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763038 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763042 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763045 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763048 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763051 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763054 2562 flags.go:64] FLAG: --system-cgroups="" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763057 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763063 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763066 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763068 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763074 2562 flags.go:64] FLAG: --tls-min-version="" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763076 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763079 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763083 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763087 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763090 2562 flags.go:64] FLAG: --v="2" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763094 2562 flags.go:64] FLAG: --version="false" Jun 08 19:33:33.771734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763098 2562 flags.go:64] FLAG: --vmodule="" Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763103 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.763106 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763231 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763235 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763238 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763241 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763243 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763246 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763249 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763251 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763254 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763256 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763259 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763262 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763264 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763267 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763276 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763280 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:33.772398 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763283 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763286 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763289 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763293 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763296 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763299 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763303 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763306 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763309 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763311 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763315 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763318 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763326 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763329 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763332 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763335 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763337 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763340 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763342 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763345 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:33.772898 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763348 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763350 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763353 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763355 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763358 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763362 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763365 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763367 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763371 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763373 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763394 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763404 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763407 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763410 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763413 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763416 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763419 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763421 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763439 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:33.773384 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763442 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763445 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763447 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763452 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763454 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763457 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763460 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763462 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763465 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763468 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763470 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763473 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763476 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763479 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763482 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763484 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763487 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763490 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763492 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763495 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:33.773889 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763498 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763500 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763504 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763508 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763511 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.763558 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765411 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765461 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765468 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765475 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765481 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765487 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765492 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765498 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765503 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765508 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765513 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765517 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765529 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:33.774378 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765534 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765539 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765543 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765548 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.765554 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.765563 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.772352 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.772369 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.773139 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.773148 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773217 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773223 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773228 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773231 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:33.774951 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773235 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773237 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773241 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773244 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773247 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773250 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773254 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773257 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773260 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773263 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773266 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773269 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773271 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773274 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773276 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773279 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773282 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773284 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773290 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:33.775300 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773293 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773296 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773299 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773301 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773304 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773306 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773309 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773311 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773314 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773317 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773320 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773322 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773325 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773328 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773331 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773334 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773336 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773339 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773342 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773344 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:33.775791 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773347 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773350 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773354 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773356 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773359 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773362 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773364 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773367 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773369 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773372 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773374 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773377 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773381 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773384 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773388 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773391 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773394 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773397 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773401 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:33.776277 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773403 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773406 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773408 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773411 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773414 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773416 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773419 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773421 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773424 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773438 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773441 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773444 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773447 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773450 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773453 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773455 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773458 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773461 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773464 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773468 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:33.776751 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773472 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773475 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773478 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773480 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773483 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773486 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773488 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773491 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773493 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773496 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773498 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773502 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773505 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773508 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773511 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773514 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:33.777240 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773516 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.773522 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773644 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773648 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773652 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773655 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773658 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773661 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773664 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773667 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773670 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773673 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773676 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773678 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773681 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 19:33:33.777656 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773684 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773686 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773689 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773692 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773694 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773697 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773699 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773702 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773705 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773707 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773710 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773712 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773716 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773720 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773724 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773727 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773731 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773734 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773737 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 19:33:33.778033 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773740 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773742 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773745 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773747 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773750 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773753 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773755 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773758 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773760 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773763 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773766 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773768 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773771 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773773 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773776 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773778 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773781 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773784 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773786 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773789 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 19:33:33.778653 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773791 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773795 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773798 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773801 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773804 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773807 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773810 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773812 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773815 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773818 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773821 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773823 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773826 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773829 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773831 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773834 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773837 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773839 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773842 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773845 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 19:33:33.779142 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773847 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773850 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773852 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773856 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773858 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773861 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773864 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773866 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773869 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773871 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773873 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773876 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773879 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773882 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773884 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773887 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773889 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773892 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773895 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773898 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 19:33:33.779645 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773900 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773904 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773907 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773910 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773913 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773916 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.773919 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.773924 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.774055 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.776093 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.777554 2562 server.go:1019] "Starting client certificate rotation" Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.777657 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:33:33.780129 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.777690 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 19:33:33.781112 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.781096 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:33:33.782362 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.782344 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 19:33:33.793173 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.793151 2562 log.go:25] "Validated CRI v1 runtime API" Jun 08 19:33:33.795923 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.795901 2562 log.go:25] "Validated CRI v1 image API" Jun 08 19:33:33.796839 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.796824 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 19:33:33.801718 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.801699 2562 fs.go:135] Filesystem UUIDs: map[46aca946-d67f-4885-8f46-be504899fd95:/dev/nvme0n1p3 76684a40-0e12-4e72-95d7-380b0756962a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 08 19:33:33.801784 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.801718 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 19:33:33.805908 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.805879 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:33:33.809276 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.809157 2562 manager.go:216] Machine: {Timestamp:2026-06-08 19:33:33.807848199 +0000 UTC m=+0.362868655 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106319 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22699d2f21f7bf87bec1dd340c56f0 SystemUUID:ec22699d-2f21-f7bf-87be-c1dd340c56f0 BootID:69bdc14c-d2a9-4108-96b3-bdeeb72874df Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:4b:e4:6d:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:4b:e4:6d:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:9e:3f:53:21:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 19:33:33.809276 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.809265 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 19:33:33.809416 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.809352 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 19:33:33.813065 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.813035 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 19:33:33.813208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.813069 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 19:33:33.813958 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.813948 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 19:33:33.813998 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.813960 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 19:33:33.813998 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.813968 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:33:33.814830 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.814819 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 19:33:33.815680 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.815668 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 19:33:33.818336 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.818322 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:33:33.818484 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.818474 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 19:33:33.818516 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.818507 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 08 19:33:33.818543 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.818522 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 19:33:33.818571 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.818547 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 19:33:33.818571 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.818560 2562 kubelet.go:398] "Adding apiserver pod source" Jun 08 19:33:33.818627 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.818572 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 19:33:33.819026 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.819014 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:33:33.819093 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.819037 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 19:33:33.821552 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.821536 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 19:33:33.823115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.823102 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 19:33:33.823159 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.823133 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 19:33:33.824136 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824121 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 19:33:33.824170 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824147 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 19:33:33.824170 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824157 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 19:33:33.824170 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824166 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 19:33:33.824263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824179 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 19:33:33.824263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824186 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 19:33:33.824263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824194 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 19:33:33.824263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824202 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 19:33:33.824263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824213 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 19:33:33.824263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824221 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 19:33:33.824263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824246 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 19:33:33.824263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.824255 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 19:33:33.825272 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.825261 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 19:33:33.825307 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.825275 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 19:33:33.828656 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.828636 2562 server.go:1268] "Started kubelet" Jun 08 19:33:33.828840 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.828783 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 19:33:33.829038 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.828866 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 19:33:33.829138 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.829068 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 19:33:33.829195 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.829183 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 19:33:33.829359 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.829338 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jsd7f" Jun 08 19:33:33.829496 ip-10-0-133-234 systemd[1]: Started Kubernetes Kubelet. Jun 08 19:33:33.830805 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.830784 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 19:33:33.830865 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.830786 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 19:33:33.831381 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.831355 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 19:33:33.831797 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.831783 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 08 19:33:33.834597 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.833445 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-234.ec2.internal.18b7320e1bf9bd7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-234.ec2.internal,UID:ip-10-0-133-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-234.ec2.internal,},FirstTimestamp:2026-06-08 19:33:33.828603263 +0000 UTC m=+0.383623723,LastTimestamp:2026-06-08 19:33:33.828603263 +0000 UTC m=+0.383623723,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-234.ec2.internal,}" Jun 08 19:33:33.836112 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.836096 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 19:33:33.836208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.836138 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 19:33:33.836208 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.836171 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:33.836821 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.836803 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 19:33:33.836908 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.836824 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 19:33:33.837062 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.836927 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 08 19:33:33.837062 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.836939 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 08 19:33:33.837376 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.837356 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 19:33:33.837960 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.837537 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jsd7f" Jun 08 19:33:33.837960 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.837769 2562 factory.go:55] Registering systemd factory Jun 08 19:33:33.837960 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.837787 2562 factory.go:223] Registration of the systemd container factory successfully Jun 08 19:33:33.838184 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.838111 2562 factory.go:153] Registering CRI-O factory Jun 08 19:33:33.838184 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.838124 2562 factory.go:223] Registration of the crio container factory successfully Jun 08 19:33:33.838275 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.838185 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 19:33:33.838275 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.838209 2562 factory.go:103] Registering Raw factory Jun 08 19:33:33.838275 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.838226 2562 manager.go:1196] Started watching for new ooms in manager Jun 08 19:33:33.838737 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.838722 2562 manager.go:349] Starting recovery of all containers Jun 08 19:33:33.838827 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.838776 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 19:33:33.838916 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.838886 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 19:33:33.840242 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.840215 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 19:33:33.847904 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:33.847709 2562 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.swap.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.swap.max: no such device Jun 08 19:33:33.850030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.850012 2562 manager.go:354] Recovery completed Jun 08 19:33:33.854174 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.854160 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:33.855788 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.855773 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:33.855859 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.855806 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:33.855859 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.855821 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:33.856337 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.856324 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 19:33:33.856337 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.856334 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:33.856450 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.856338 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 19:33:33.856450 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.856369 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 08 19:33:33.856980 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.856964 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:33.857025 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.856991 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:33.857025 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.857002 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:33.857625 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.857611 2562 policy_none.go:49] "None policy: Start" Jun 08 19:33:33.857673 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.857628 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 19:33:33.857673 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.857640 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 19:33:33.858721 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.858710 2562 policy_none.go:47] "Start" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.901146 2562 manager.go:337] "Starting Device Plugin manager" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.901176 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.901185 2562 server.go:87] "Starting device plugin registration server" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.901526 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.901583 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.901695 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.901795 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.901808 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.902303 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.902348 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.912887 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.914084 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.914121 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.914142 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:33.914178 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 19:33:33.919311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:33.917078 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:34.001791 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.001743 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:34.002768 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.002751 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:34.002871 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.002781 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:34.002871 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.002791 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:34.002871 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.002837 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.012178 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.012095 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.012178 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.012124 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-234.ec2.internal\": node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.014483 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.014460 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal"] Jun 08 19:33:34.014571 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.014544 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:34.016190 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.016172 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:34.016269 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.016202 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:34.016269 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.016213 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:34.017515 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.017503 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:34.017682 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.017662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.017732 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.017691 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:34.018462 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.018417 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:34.018567 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.018468 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:34.018567 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.018424 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:34.018567 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.018479 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:34.018567 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.018497 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:34.018567 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.018508 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:34.020592 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.020572 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.020684 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.020605 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 19:33:34.021404 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.021384 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory" Jun 08 19:33:34.021522 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.021417 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 19:33:34.021522 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.021445 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID" Jun 08 19:33:34.031348 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.031329 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.045387 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.045361 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-234.ec2.internal\" not found" node="ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.050088 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.050072 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-234.ec2.internal\" not found" node="ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.132216 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.132182 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.138571 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.138541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a762ae7e7a7f417a1104c8cf7abc6b97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"a762ae7e7a7f417a1104c8cf7abc6b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.138662 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.138579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a762ae7e7a7f417a1104c8cf7abc6b97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"a762ae7e7a7f417a1104c8cf7abc6b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.138662 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.138598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc8eed032c0c452db97abed635e2c60c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-234.ec2.internal\" (UID: \"bc8eed032c0c452db97abed635e2c60c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.233258 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.233217 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.239688 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.239661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a762ae7e7a7f417a1104c8cf7abc6b97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"a762ae7e7a7f417a1104c8cf7abc6b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.239771 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.239702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a762ae7e7a7f417a1104c8cf7abc6b97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"a762ae7e7a7f417a1104c8cf7abc6b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.239771 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.239730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc8eed032c0c452db97abed635e2c60c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-234.ec2.internal\" (UID: \"bc8eed032c0c452db97abed635e2c60c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.239771 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.239756 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a762ae7e7a7f417a1104c8cf7abc6b97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"a762ae7e7a7f417a1104c8cf7abc6b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.239771 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.239763 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc8eed032c0c452db97abed635e2c60c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-234.ec2.internal\" (UID: \"bc8eed032c0c452db97abed635e2c60c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.239914 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.239762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a762ae7e7a7f417a1104c8cf7abc6b97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"a762ae7e7a7f417a1104c8cf7abc6b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.334188 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.334114 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.349656 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.349626 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.354502 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.354477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jun 08 19:33:34.435165 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.435124 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.535730 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.535698 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.636261 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.636181 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.736705 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.736675 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.777109 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.777080 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 19:33:34.777602 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.777253 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 19:33:34.799385 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.799358 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:34.837234 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.837196 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:34.841051 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.841012 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 19:28:33 +0000 UTC" deadline="2027-11-04 09:16:17.634031204 +0000 UTC" Jun 08 19:33:34.841051 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.841050 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12325h42m42.79298646s" Jun 08 19:33:34.856106 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:34.856054 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda762ae7e7a7f417a1104c8cf7abc6b97.slice/crio-d1e509f0f65d585e99cc4cdb37a9da55b8904e8d86a6cf274d9bea8ff000c025 WatchSource:0}: Error finding container d1e509f0f65d585e99cc4cdb37a9da55b8904e8d86a6cf274d9bea8ff000c025: Status 404 returned error can't find the container with id d1e509f0f65d585e99cc4cdb37a9da55b8904e8d86a6cf274d9bea8ff000c025 Jun 08 19:33:34.856508 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:34.856490 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8eed032c0c452db97abed635e2c60c.slice/crio-1f369d4fb818958aa35ce010d083dae0adf4242ddc4f4ef4ef8197bbb12af202 WatchSource:0}: Error finding container 1f369d4fb818958aa35ce010d083dae0adf4242ddc4f4ef4ef8197bbb12af202: Status 404 returned error can't find the container with id 1f369d4fb818958aa35ce010d083dae0adf4242ddc4f4ef4ef8197bbb12af202 Jun 08 19:33:34.860830 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.860814 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:33:34.917384 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.917273 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" event={"ID":"a762ae7e7a7f417a1104c8cf7abc6b97","Type":"ContainerStarted","Data":"d1e509f0f65d585e99cc4cdb37a9da55b8904e8d86a6cf274d9bea8ff000c025"} Jun 08 19:33:34.920558 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:34.920530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" event={"ID":"bc8eed032c0c452db97abed635e2c60c","Type":"ContainerStarted","Data":"1f369d4fb818958aa35ce010d083dae0adf4242ddc4f4ef4ef8197bbb12af202"} Jun 08 19:33:34.937785 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:34.937761 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:35.030229 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.030201 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:35.037981 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.037956 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:35.138456 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.138413 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:35.238944 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.238864 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:35.339766 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.339728 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found" Jun 08 19:33:35.348624 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.348449 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:35.436778 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.436576 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" Jun 08 19:33:35.447748 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.447724 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:33:35.448840 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.448814 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" Jun 08 19:33:35.457558 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.457525 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 19:33:35.819840 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.819788 2562 apiserver.go:52] "Watching apiserver" Jun 08 19:33:35.827814 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.827786 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 19:33:35.828221 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.828189 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-sx9xl","openshift-ovn-kubernetes/ovnkube-node-wkpqb","kube-system/global-pull-secret-syncer-zdflj","openshift-cluster-node-tuning-operator/tuned-6mczp","openshift-dns/node-resolver-xbc4h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal","openshift-multus/multus-additional-cni-plugins-xjfg4","openshift-multus/multus-jpmc9","openshift-multus/network-metrics-daemon-6qp7m","openshift-network-diagnostics/network-check-target-vlqgh","kube-system/konnectivity-agent-h5k5x","kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7","openshift-image-registry/node-ca-9hfwf"] Jun 08 19:33:35.829703 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.829683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.830899 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.830877 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.831943 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.831912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:35.832036 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.831986 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:35.832289 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.832270 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 19:33:35.832378 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.832359 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 19:33:35.832643 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.832612 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 19:33:35.832845 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.832718 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 19:33:35.832845 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.832729 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k4jh4\"" Jun 08 19:33:35.832845 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.832717 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 19:33:35.833084 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.833067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.833353 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.833336 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 19:33:35.833609 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.833590 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 19:33:35.833696 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.833637 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 19:33:35.834305 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.834212 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5794g\"" Jun 08 19:33:35.834400 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.834338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.835246 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.835224 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:33:35.835584 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.835565 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-24wc6\"" Jun 08 19:33:35.835695 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.835568 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 19:33:35.836289 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.835993 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.837054 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.836873 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 19:33:35.837054 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.836926 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 19:33:35.837054 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.836931 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ff8nd\"" Jun 08 19:33:35.837262 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.837212 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 19:33:35.838811 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.838462 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 19:33:35.838811 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.838498 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 19:33:35.838811 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.838780 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5bthk\"" Jun 08 19:33:35.839121 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.839097 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 19:33:35.839598 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.839574 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:35.839682 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.839659 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:35.841531 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.840821 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:35.842739 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.842715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.843027 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.843004 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:33:35.843493 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.843474 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 19:33:35.843592 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.843493 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 19:33:35.843592 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.843583 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zj2ns\"" Jun 08 19:33:35.844134 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.844114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:35.844217 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.844192 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:35.844982 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.844964 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 19:33:35.845110 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.845089 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mp8cj\"" Jun 08 19:33:35.845241 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.845223 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 19:33:35.845323 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.845302 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 19:33:35.845323 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.845322 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 19:33:35.845759 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.845738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:35.846469 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.846289 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 19:33:35.846469 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.846324 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 19:33:35.847034 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.847014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.847947 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.847923 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 19:33:35.848079 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848060 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xrwbk\"" Jun 08 19:33:35.848153 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848060 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 19:33:35.848258 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-systemd\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.848345 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-run\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.848345 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e5fe73f-5e92-40f3-ac32-9300d24d5102-dbus\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:35.848345 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc4t2\" (UniqueName: \"kubernetes.io/projected/3a09e5c9-6a4d-4261-8eaa-0df67a903e2e-kube-api-access-vc4t2\") pod \"node-resolver-xbc4h\" (UID: \"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e\") " pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.848345 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848331 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-system-cni-dir\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848344 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3a8a391-600f-44b4-a0be-54684c9ad5d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-var-lib-kubelet\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3a8a391-600f-44b4-a0be-54684c9ad5d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-os-release\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848519 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q86tl\" (UniqueName: \"kubernetes.io/projected/b3a8a391-600f-44b4-a0be-54684c9ad5d2-kube-api-access-q86tl\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-sysctl-d\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848582 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-host\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aef26922-f1bc-4db5-ad6d-89ac2e3adea4-host\") pod \"node-ca-9hfwf\" (UID: \"aef26922-f1bc-4db5-ad6d-89ac2e3adea4\") " pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.848639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-registration-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-device-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aef26922-f1bc-4db5-ad6d-89ac2e3adea4-serviceca\") pod \"node-ca-9hfwf\" (UID: \"aef26922-f1bc-4db5-ad6d-89ac2e3adea4\") " pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-sys-fs\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848818 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7845\" (UniqueName: \"kubernetes.io/projected/be2d95f4-add9-4aaf-be17-2c62db32ad59-kube-api-access-r7845\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a09e5c9-6a4d-4261-8eaa-0df67a903e2e-hosts-file\") pod \"node-resolver-xbc4h\" (UID: \"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e\") " pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-tmp\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldrg5\" (UniqueName: \"kubernetes.io/projected/aef26922-f1bc-4db5-ad6d-89ac2e3adea4-kube-api-access-ldrg5\") pod \"node-ca-9hfwf\" (UID: \"aef26922-f1bc-4db5-ad6d-89ac2e3adea4\") " pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-cnibin\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3a8a391-600f-44b4-a0be-54684c9ad5d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-sysconfig\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.848982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-lib-modules\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-tuned\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-modprobe-d\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.849115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849088 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-sys\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8nm7\" (UniqueName: \"kubernetes.io/projected/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-kube-api-access-k8nm7\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849132 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-socket-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d277h\" (UniqueName: \"kubernetes.io/projected/930e47a3-7e09-414e-b7b2-0d927ad09de8-kube-api-access-d277h\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e5fe73f-5e92-40f3-ac32-9300d24d5102-kubelet-config\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a09e5c9-6a4d-4261-8eaa-0df67a903e2e-tmp-dir\") pod \"node-resolver-xbc4h\" (UID: \"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e\") " pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849326 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-kubernetes\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-sysctl-conf\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.849860 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.849501 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4vfgj\"" Jun 08 19:33:35.874656 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.874622 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjnf9" Jun 08 19:33:35.882570 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.882541 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjnf9" Jun 08 19:33:35.938332 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.938306 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 19:33:35.950581 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.950549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d277h\" (UniqueName: \"kubernetes.io/projected/930e47a3-7e09-414e-b7b2-0d927ad09de8-kube-api-access-d277h\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:35.950749 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.950591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e5fe73f-5e92-40f3-ac32-9300d24d5102-kubelet-config\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:35.950749 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.950625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-ovnkube-config\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.950749 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.950650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-run-k8s-cni-cncf-io\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.950749 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.950676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-conf-dir\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.950749 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.950702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjzrz\" (UniqueName: \"kubernetes.io/projected/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-kube-api-access-bjzrz\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-kubernetes\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-sysctl-conf\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-run\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e5fe73f-5e92-40f3-ac32-9300d24d5102-dbus\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.950693 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e5fe73f-5e92-40f3-ac32-9300d24d5102-kubelet-config\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc4t2\" (UniqueName: \"kubernetes.io/projected/3a09e5c9-6a4d-4261-8eaa-0df67a903e2e-kube-api-access-vc4t2\") pod \"node-resolver-xbc4h\" (UID: \"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e\") " pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-run-ovn-kubernetes\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-sysctl-conf\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e5fe73f-5e92-40f3-ac32-9300d24d5102-dbus\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-run\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.951938 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.951866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-kubernetes\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952071 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-socket-dir-parent\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-system-cni-dir\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-var-lib-kubelet\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-hostroot\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-systemd-units\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-cni-netd\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-cni-dir\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-sysctl-d\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-registration-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a09e5c9-6a4d-4261-8eaa-0df67a903e2e-hosts-file\") pod \"node-resolver-xbc4h\" (UID: \"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e\") " pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z55sz\" (UniqueName: \"kubernetes.io/projected/b26faca9-364e-47dd-86e2-45e634f2353e-kube-api-access-z55sz\") pod \"iptables-alerter-sx9xl\" (UID: \"b26faca9-364e-47dd-86e2-45e634f2353e\") " pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-cni-binary-copy\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-sys-fs\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7845\" (UniqueName: \"kubernetes.io/projected/be2d95f4-add9-4aaf-be17-2c62db32ad59-kube-api-access-r7845\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-run-ovn\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-node-log\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.952641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-cni-bin\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952692 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-system-cni-dir\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-os-release\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-var-lib-kubelet\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-sysctl-d\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-registration-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-var-lib-kubelet\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldrg5\" (UniqueName: \"kubernetes.io/projected/aef26922-f1bc-4db5-ad6d-89ac2e3adea4-kube-api-access-ldrg5\") pod \"node-ca-9hfwf\" (UID: \"aef26922-f1bc-4db5-ad6d-89ac2e3adea4\") " pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a09e5c9-6a4d-4261-8eaa-0df67a903e2e-hosts-file\") pod \"node-resolver-xbc4h\" (UID: \"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e\") " pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.952960 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-sys-fs\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3a8a391-600f-44b4-a0be-54684c9ad5d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-sysconfig\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.953346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-lib-modules\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-lib-modules\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-env-overrides\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bkn2\" (UniqueName: \"kubernetes.io/projected/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-kube-api-access-9bkn2\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953655 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-var-lib-cni-bin\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-modprobe-d\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-sys\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-kubelet\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.953883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-run-openvswitch\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-run-netns\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953940 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-etc-kubernetes\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3a8a391-600f-44b4-a0be-54684c9ad5d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.953974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a09e5c9-6a4d-4261-8eaa-0df67a903e2e-tmp-dir\") pod \"node-resolver-xbc4h\" (UID: \"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e\") " pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11999dd3-1fdf-4bcf-92c3-93be6cf1218c-agent-certs\") pod \"konnectivity-agent-h5k5x\" (UID: \"11999dd3-1fdf-4bcf-92c3-93be6cf1218c\") " pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954122 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-modprobe-d\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-system-cni-dir\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954175 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954178 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-sysconfig\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-run-multus-certs\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-systemd\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-sys\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.954324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-systemd\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3a8a391-600f-44b4-a0be-54684c9ad5d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-var-lib-cni-multus\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3a8a391-600f-44b4-a0be-54684c9ad5d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a09e5c9-6a4d-4261-8eaa-0df67a903e2e-tmp-dir\") pod \"node-resolver-xbc4h\" (UID: \"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e\") " pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.954671 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3a8a391-600f-44b4-a0be-54684c9ad5d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-os-release\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q86tl\" (UniqueName: \"kubernetes.io/projected/b3a8a391-600f-44b4-a0be-54684c9ad5d2-kube-api-access-q86tl\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.954975 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.954960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-host\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aef26922-f1bc-4db5-ad6d-89ac2e3adea4-host\") pod \"node-ca-9hfwf\" (UID: \"aef26922-f1bc-4db5-ad6d-89ac2e3adea4\") " pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-device-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11999dd3-1fdf-4bcf-92c3-93be6cf1218c-konnectivity-ca\") pod \"konnectivity-agent-h5k5x\" (UID: \"11999dd3-1fdf-4bcf-92c3-93be6cf1218c\") " pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3a8a391-600f-44b4-a0be-54684c9ad5d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aef26922-f1bc-4db5-ad6d-89ac2e3adea4-serviceca\") pod \"node-ca-9hfwf\" (UID: \"aef26922-f1bc-4db5-ad6d-89ac2e3adea4\") " pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b26faca9-364e-47dd-86e2-45e634f2353e-host-slash\") pod \"iptables-alerter-sx9xl\" (UID: \"b26faca9-364e-47dd-86e2-45e634f2353e\") " pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955253 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aef26922-f1bc-4db5-ad6d-89ac2e3adea4-host\") pod \"node-ca-9hfwf\" (UID: \"aef26922-f1bc-4db5-ad6d-89ac2e3adea4\") " pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.955299 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret podName:7e5fe73f-5e92-40f3-ac32-9300d24d5102 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:36.45524862 +0000 UTC m=+3.010269081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret") pod "global-pull-secret-syncer-zdflj" (UID: "7e5fe73f-5e92-40f3-ac32-9300d24d5102") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-slash\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-os-release\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.955395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-log-socket\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.955969 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.955451 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:35.955969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955571 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-device-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.955969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955733 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-host\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.955969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aef26922-f1bc-4db5-ad6d-89ac2e3adea4-serviceca\") pod \"node-ca-9hfwf\" (UID: \"aef26922-f1bc-4db5-ad6d-89ac2e3adea4\") " pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.955969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-ovnkube-script-lib\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.955969 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:35.955825 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:36.455808815 +0000 UTC m=+3.010829260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:35.955969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-cnibin\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.955969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-tmp\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.956293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.955981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-cnibin\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.956293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-tuned\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.956293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956039 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-cnibin\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.956293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b26faca9-364e-47dd-86e2-45e634f2353e-iptables-alerter-script\") pod \"iptables-alerter-sx9xl\" (UID: \"b26faca9-364e-47dd-86e2-45e634f2353e\") " pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:35.956293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-run-systemd\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-daemon-config\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956676 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8nm7\" (UniqueName: \"kubernetes.io/projected/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-kube-api-access-k8nm7\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-socket-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-run-netns\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-var-lib-openvswitch\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-etc-openvswitch\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956849 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3a8a391-600f-44b4-a0be-54684c9ad5d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.956968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be2d95f4-add9-4aaf-be17-2c62db32ad59-socket-dir\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.957105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.957033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-ovn-node-metrics-cert\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:35.960420 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.960382 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-tmp\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.960523 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.960474 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-etc-tuned\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:35.960875 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.960848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc4t2\" (UniqueName: \"kubernetes.io/projected/3a09e5c9-6a4d-4261-8eaa-0df67a903e2e-kube-api-access-vc4t2\") pod \"node-resolver-xbc4h\" (UID: \"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e\") " pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:35.960953 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.960848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d277h\" (UniqueName: \"kubernetes.io/projected/930e47a3-7e09-414e-b7b2-0d927ad09de8-kube-api-access-d277h\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:35.961086 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.961062 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldrg5\" (UniqueName: \"kubernetes.io/projected/aef26922-f1bc-4db5-ad6d-89ac2e3adea4-kube-api-access-ldrg5\") pod \"node-ca-9hfwf\" (UID: \"aef26922-f1bc-4db5-ad6d-89ac2e3adea4\") " pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:35.962373 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.962350 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7845\" (UniqueName: \"kubernetes.io/projected/be2d95f4-add9-4aaf-be17-2c62db32ad59-kube-api-access-r7845\") pod \"aws-ebs-csi-driver-node-ftnh7\" (UID: \"be2d95f4-add9-4aaf-be17-2c62db32ad59\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:35.963369 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.963346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q86tl\" (UniqueName: \"kubernetes.io/projected/b3a8a391-600f-44b4-a0be-54684c9ad5d2-kube-api-access-q86tl\") pod \"multus-additional-cni-plugins-xjfg4\" (UID: \"b3a8a391-600f-44b4-a0be-54684c9ad5d2\") " pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:35.964013 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:35.963995 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8nm7\" (UniqueName: \"kubernetes.io/projected/fbb3b0f1-d7e0-4173-acfc-09de2ea8371c-kube-api-access-k8nm7\") pod \"tuned-6mczp\" (UID: \"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c\") " pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:36.057794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11999dd3-1fdf-4bcf-92c3-93be6cf1218c-agent-certs\") pod \"konnectivity-agent-h5k5x\" (UID: \"11999dd3-1fdf-4bcf-92c3-93be6cf1218c\") " pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:36.057794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-system-cni-dir\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.058030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-run-multus-certs\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.058030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-var-lib-cni-multus\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.058030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057893 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-system-cni-dir\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.058030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057882 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-var-lib-cni-multus\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.058030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057905 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-run-multus-certs\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.058030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11999dd3-1fdf-4bcf-92c3-93be6cf1218c-konnectivity-ca\") pod \"konnectivity-agent-h5k5x\" (UID: \"11999dd3-1fdf-4bcf-92c3-93be6cf1218c\") " pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:36.058030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b26faca9-364e-47dd-86e2-45e634f2353e-host-slash\") pod \"iptables-alerter-sx9xl\" (UID: \"b26faca9-364e-47dd-86e2-45e634f2353e\") " pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:36.058030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.057993 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-slash\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058030 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b26faca9-364e-47dd-86e2-45e634f2353e-host-slash\") pod \"iptables-alerter-sx9xl\" (UID: \"b26faca9-364e-47dd-86e2-45e634f2353e\") " pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-log-socket\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-log-socket\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-ovnkube-script-lib\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-slash\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-cnibin\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b26faca9-364e-47dd-86e2-45e634f2353e-iptables-alerter-script\") pod \"iptables-alerter-sx9xl\" (UID: \"b26faca9-364e-47dd-86e2-45e634f2353e\") " pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-cnibin\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-run-systemd\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-daemon-config\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-run-netns\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-var-lib-openvswitch\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-etc-openvswitch\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-ovn-node-metrics-cert\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-ovnkube-config\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.058475 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-run-k8s-cni-cncf-io\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-conf-dir\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjzrz\" (UniqueName: \"kubernetes.io/projected/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-kube-api-access-bjzrz\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-run-ovn-kubernetes\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-socket-dir-parent\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-hostroot\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-systemd-units\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058642 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11999dd3-1fdf-4bcf-92c3-93be6cf1218c-konnectivity-ca\") pod \"konnectivity-agent-h5k5x\" (UID: \"11999dd3-1fdf-4bcf-92c3-93be6cf1218c\") " pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-cni-netd\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-cni-dir\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-ovnkube-script-lib\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-cni-dir\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z55sz\" (UniqueName: \"kubernetes.io/projected/b26faca9-364e-47dd-86e2-45e634f2353e-kube-api-access-z55sz\") pod \"iptables-alerter-sx9xl\" (UID: \"b26faca9-364e-47dd-86e2-45e634f2353e\") " pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-conf-dir\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058766 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-etc-openvswitch\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058796 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-cni-binary-copy\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058812 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-run-systemd\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.059208 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-run-ovn\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-node-log\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-cni-bin\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-os-release\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-var-lib-kubelet\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-run-ovn-kubernetes\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-run-netns\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-env-overrides\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bkn2\" (UniqueName: \"kubernetes.io/projected/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-kube-api-access-9bkn2\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.058988 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-socket-dir-parent\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-var-lib-cni-bin\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-hostroot\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059032 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-ovnkube-config\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059044 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-systemd-units\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059068 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-cni-netd\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-kubelet\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059097 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-run-k8s-cni-cncf-io\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060024 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-multus-daemon-config\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-kubelet\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-run-openvswitch\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059158 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-run-openvswitch\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059169 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-var-lib-openvswitch\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-run-netns\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-etc-kubernetes\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b26faca9-364e-47dd-86e2-45e634f2353e-iptables-alerter-script\") pod \"iptables-alerter-sx9xl\" (UID: \"b26faca9-364e-47dd-86e2-45e634f2353e\") " pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-var-lib-kubelet\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059220 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-os-release\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059288 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-node-log\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059329 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-host-cni-bin\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-etc-kubernetes\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-run-ovn\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059356 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-var-lib-cni-bin\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-host-run-netns\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-env-overrides\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.059929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-cni-binary-copy\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.060678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.060594 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11999dd3-1fdf-4bcf-92c3-93be6cf1218c-agent-certs\") pod \"konnectivity-agent-h5k5x\" (UID: \"11999dd3-1fdf-4bcf-92c3-93be6cf1218c\") " pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:36.061245 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.060988 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-ovn-node-metrics-cert\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.067347 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.067323 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:36.067490 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.067352 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:36.067490 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.067366 2562 projected.go:196] Error preparing data for projected volume kube-api-access-247ws for pod openshift-network-diagnostics/network-check-target-vlqgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:36.067490 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.067445 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws podName:c0e07055-23d7-417e-9dbc-0b57355c8bd2 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:36.567409843 +0000 UTC m=+3.122430304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-247ws" (UniqueName: "kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws") pod "network-check-target-vlqgh" (UID: "c0e07055-23d7-417e-9dbc-0b57355c8bd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:36.069476 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.069453 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjzrz\" (UniqueName: \"kubernetes.io/projected/efb93724-6f1a-4fd3-aa24-3b59d27a4d90-kube-api-access-bjzrz\") pod \"multus-jpmc9\" (UID: \"efb93724-6f1a-4fd3-aa24-3b59d27a4d90\") " pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.070040 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.069978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z55sz\" (UniqueName: \"kubernetes.io/projected/b26faca9-364e-47dd-86e2-45e634f2353e-kube-api-access-z55sz\") pod \"iptables-alerter-sx9xl\" (UID: \"b26faca9-364e-47dd-86e2-45e634f2353e\") " pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:36.070040 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.070028 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bkn2\" (UniqueName: \"kubernetes.io/projected/9da1f431-17eb-41ab-8ecb-8da7f49ee78a-kube-api-access-9bkn2\") pod \"ovnkube-node-wkpqb\" (UID: \"9da1f431-17eb-41ab-8ecb-8da7f49ee78a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.142885 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.142844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" Jun 08 19:33:36.151577 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.151550 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" Jun 08 19:33:36.160009 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.159983 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6mczp" Jun 08 19:33:36.164658 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.164638 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xbc4h" Jun 08 19:33:36.172274 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.172255 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9hfwf" Jun 08 19:33:36.180921 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.180900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sx9xl" Jun 08 19:33:36.188578 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.188557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:33:36.196306 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.196281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:36.198714 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.198696 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 19:33:36.200731 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.200714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jpmc9" Jun 08 19:33:36.461872 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.461794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:36.461872 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.461832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:36.462118 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.461939 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:36.462118 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.461946 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:36.462118 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.461986 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:37.461972307 +0000 UTC m=+4.016992751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:36.462118 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.461999 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret podName:7e5fe73f-5e92-40f3-ac32-9300d24d5102 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:37.461993615 +0000 UTC m=+4.017014058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret") pod "global-pull-secret-syncer-zdflj" (UID: "7e5fe73f-5e92-40f3-ac32-9300d24d5102") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:36.582527 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:36.582493 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2d95f4_add9_4aaf_be17_2c62db32ad59.slice/crio-82c168e3b637a4b576804d664e59f1a5d909feebba130a067cab6eac66652724 WatchSource:0}: Error finding container 82c168e3b637a4b576804d664e59f1a5d909feebba130a067cab6eac66652724: Status 404 returned error can't find the container with id 82c168e3b637a4b576804d664e59f1a5d909feebba130a067cab6eac66652724 Jun 08 19:33:36.583377 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:36.583353 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26faca9_364e_47dd_86e2_45e634f2353e.slice/crio-48bd601b61503bec2542fb123e961691c7e0eb1f99c255528f3e4e88b50fbba1 WatchSource:0}: Error finding container 48bd601b61503bec2542fb123e961691c7e0eb1f99c255528f3e4e88b50fbba1: Status 404 returned error can't find the container with id 48bd601b61503bec2542fb123e961691c7e0eb1f99c255528f3e4e88b50fbba1 Jun 08 19:33:36.584241 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:36.584170 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a8a391_600f_44b4_a0be_54684c9ad5d2.slice/crio-70b5fdf78e84695626c5698c4a448e691db2ab69e984b9a82846fcdac98fb1c2 WatchSource:0}: Error finding container 70b5fdf78e84695626c5698c4a448e691db2ab69e984b9a82846fcdac98fb1c2: Status 404 returned error can't find the container with id 70b5fdf78e84695626c5698c4a448e691db2ab69e984b9a82846fcdac98fb1c2 Jun 08 19:33:36.585545 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:36.585520 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11999dd3_1fdf_4bcf_92c3_93be6cf1218c.slice/crio-626df2e1738906f5037a1aa6157ed65abd813d599f7055e68f00e7ae9abfefd1 WatchSource:0}: Error finding container 626df2e1738906f5037a1aa6157ed65abd813d599f7055e68f00e7ae9abfefd1: Status 404 returned error can't find the container with id 626df2e1738906f5037a1aa6157ed65abd813d599f7055e68f00e7ae9abfefd1 Jun 08 19:33:36.586917 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:36.586884 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb93724_6f1a_4fd3_aa24_3b59d27a4d90.slice/crio-11114a923e19cf5347e74d64149a69c88b7115690b78c46659f9329cfc129664 WatchSource:0}: Error finding container 11114a923e19cf5347e74d64149a69c88b7115690b78c46659f9329cfc129664: Status 404 returned error can't find the container with id 11114a923e19cf5347e74d64149a69c88b7115690b78c46659f9329cfc129664 Jun 08 19:33:36.589874 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:36.589849 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a09e5c9_6a4d_4261_8eaa_0df67a903e2e.slice/crio-4755f54adf5c7ef8a6b79efc57f4c06b26f9ca38d6cfbed6515bc4206d5b4f77 WatchSource:0}: Error finding container 4755f54adf5c7ef8a6b79efc57f4c06b26f9ca38d6cfbed6515bc4206d5b4f77: Status 404 returned error can't find the container with id 4755f54adf5c7ef8a6b79efc57f4c06b26f9ca38d6cfbed6515bc4206d5b4f77 Jun 08 19:33:36.590862 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:36.590828 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef26922_f1bc_4db5_ad6d_89ac2e3adea4.slice/crio-432cb8beaec8c0bb1306fba4dcff3d40c9e4b3646eba2342912f532fa24c25b5 WatchSource:0}: Error finding container 432cb8beaec8c0bb1306fba4dcff3d40c9e4b3646eba2342912f532fa24c25b5: Status 404 returned error can't find the container with id 432cb8beaec8c0bb1306fba4dcff3d40c9e4b3646eba2342912f532fa24c25b5 Jun 08 19:33:36.592204 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:36.592066 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da1f431_17eb_41ab_8ecb_8da7f49ee78a.slice/crio-51e6f6ebfe8707340b9ad00a51d665599f23ca8d2a43e37f104dec243ddb4f51 WatchSource:0}: Error finding container 51e6f6ebfe8707340b9ad00a51d665599f23ca8d2a43e37f104dec243ddb4f51: Status 404 returned error can't find the container with id 51e6f6ebfe8707340b9ad00a51d665599f23ca8d2a43e37f104dec243ddb4f51 Jun 08 19:33:36.592664 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:33:36.592613 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb3b0f1_d7e0_4173_acfc_09de2ea8371c.slice/crio-b7f2c6c19f0b962e3437081b8b4e64bf71cc1fa7b24c8e25cd614ba56718b10f WatchSource:0}: Error finding container b7f2c6c19f0b962e3437081b8b4e64bf71cc1fa7b24c8e25cd614ba56718b10f: Status 404 returned error can't find the container with id b7f2c6c19f0b962e3437081b8b4e64bf71cc1fa7b24c8e25cd614ba56718b10f Jun 08 19:33:36.665768 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.665584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:36.665879 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.665780 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:36.665879 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.665804 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:36.665879 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.665816 2562 projected.go:196] Error preparing data for projected volume kube-api-access-247ws for pod openshift-network-diagnostics/network-check-target-vlqgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:36.665879 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:36.665868 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws podName:c0e07055-23d7-417e-9dbc-0b57355c8bd2 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:37.66585075 +0000 UTC m=+4.220871194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-247ws" (UniqueName: "kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws") pod "network-check-target-vlqgh" (UID: "c0e07055-23d7-417e-9dbc-0b57355c8bd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:36.884576 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.884514 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:28:35 +0000 UTC" deadline="2028-03-04 20:11:30.662544944 +0000 UTC" Jun 08 19:33:36.884576 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.884571 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15240h37m53.777977512s" Jun 08 19:33:36.928038 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.927964 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" event={"ID":"bc8eed032c0c452db97abed635e2c60c","Type":"ContainerStarted","Data":"fdea4d884679d2dda712355ce31f28331e9dcf9a51135cacbbe12c546f9a852b"} Jun 08 19:33:36.929777 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.929741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6mczp" event={"ID":"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c","Type":"ContainerStarted","Data":"b7f2c6c19f0b962e3437081b8b4e64bf71cc1fa7b24c8e25cd614ba56718b10f"} Jun 08 19:33:36.931452 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.931332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerStarted","Data":"51e6f6ebfe8707340b9ad00a51d665599f23ca8d2a43e37f104dec243ddb4f51"} Jun 08 19:33:36.933395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.933369 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9hfwf" event={"ID":"aef26922-f1bc-4db5-ad6d-89ac2e3adea4","Type":"ContainerStarted","Data":"432cb8beaec8c0bb1306fba4dcff3d40c9e4b3646eba2342912f532fa24c25b5"} Jun 08 19:33:36.935333 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.935245 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jpmc9" event={"ID":"efb93724-6f1a-4fd3-aa24-3b59d27a4d90","Type":"ContainerStarted","Data":"11114a923e19cf5347e74d64149a69c88b7115690b78c46659f9329cfc129664"} Jun 08 19:33:36.937703 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.937673 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h5k5x" event={"ID":"11999dd3-1fdf-4bcf-92c3-93be6cf1218c","Type":"ContainerStarted","Data":"626df2e1738906f5037a1aa6157ed65abd813d599f7055e68f00e7ae9abfefd1"} Jun 08 19:33:36.939320 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.939223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" event={"ID":"b3a8a391-600f-44b4-a0be-54684c9ad5d2","Type":"ContainerStarted","Data":"70b5fdf78e84695626c5698c4a448e691db2ab69e984b9a82846fcdac98fb1c2"} Jun 08 19:33:36.940889 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.940816 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" event={"ID":"be2d95f4-add9-4aaf-be17-2c62db32ad59","Type":"ContainerStarted","Data":"82c168e3b637a4b576804d664e59f1a5d909feebba130a067cab6eac66652724"} Jun 08 19:33:36.943008 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.942720 2562 generic.go:356] "Generic (PLEG): container finished" podID="a762ae7e7a7f417a1104c8cf7abc6b97" containerID="72bb5a2e49dd271964f3eda39c98b469da22fdb348e3291ecf02a8bcfeb99c9a" exitCode=0 Jun 08 19:33:36.943008 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.942801 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" event={"ID":"a762ae7e7a7f417a1104c8cf7abc6b97","Type":"ContainerDied","Data":"72bb5a2e49dd271964f3eda39c98b469da22fdb348e3291ecf02a8bcfeb99c9a"} Jun 08 19:33:36.944966 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.944528 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" podStartSLOduration=1.9445157229999999 podStartE2EDuration="1.944515723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:36.944040743 +0000 UTC m=+3.499061212" watchObservedRunningTime="2026-06-08 19:33:36.944515723 +0000 UTC m=+3.499536188" Jun 08 19:33:36.945280 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.945259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xbc4h" event={"ID":"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e","Type":"ContainerStarted","Data":"4755f54adf5c7ef8a6b79efc57f4c06b26f9ca38d6cfbed6515bc4206d5b4f77"} Jun 08 19:33:36.947633 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:36.947607 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sx9xl" event={"ID":"b26faca9-364e-47dd-86e2-45e634f2353e","Type":"ContainerStarted","Data":"48bd601b61503bec2542fb123e961691c7e0eb1f99c255528f3e4e88b50fbba1"} Jun 08 19:33:37.472255 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:37.471346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:37.472255 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:37.471404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:37.472255 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.471617 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:37.472255 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.471682 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:39.471663838 +0000 UTC m=+6.026684288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:37.472255 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.472091 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:37.472255 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.472142 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret podName:7e5fe73f-5e92-40f3-ac32-9300d24d5102 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:39.472126646 +0000 UTC m=+6.027147108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret") pod "global-pull-secret-syncer-zdflj" (UID: "7e5fe73f-5e92-40f3-ac32-9300d24d5102") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:37.673469 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:37.672703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:37.673469 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.672902 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:37.673469 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.672924 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:37.673469 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.672936 2562 projected.go:196] Error preparing data for projected volume kube-api-access-247ws for pod openshift-network-diagnostics/network-check-target-vlqgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:37.673469 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.672999 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws podName:c0e07055-23d7-417e-9dbc-0b57355c8bd2 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:39.672981552 +0000 UTC m=+6.228001998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-247ws" (UniqueName: "kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws") pod "network-check-target-vlqgh" (UID: "c0e07055-23d7-417e-9dbc-0b57355c8bd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:37.884841 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:37.884712 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 19:28:35 +0000 UTC" deadline="2027-12-08 02:40:40.920969783 +0000 UTC" Jun 08 19:33:37.884841 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:37.884756 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13135h7m3.036218005s" Jun 08 19:33:37.918693 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:37.917637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:37.918693 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.917756 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:37.918693 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:37.917837 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:37.918693 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.917918 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:37.918693 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:37.917971 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:37.918693 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:37.918034 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:37.964059 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:37.964023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" event={"ID":"a762ae7e7a7f417a1104c8cf7abc6b97","Type":"ContainerStarted","Data":"c39eccfea4d6f925f4046ac21b72de2d9efd7ad937cc2016f1750888e6af2028"} Jun 08 19:33:39.490700 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:39.490652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:39.491180 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:39.490709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:39.491180 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.490864 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:39.491180 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.490928 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:43.490909439 +0000 UTC m=+10.045929898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:39.491355 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.491318 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:39.491404 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.491364 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret podName:7e5fe73f-5e92-40f3-ac32-9300d24d5102 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:43.491349877 +0000 UTC m=+10.046370325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret") pod "global-pull-secret-syncer-zdflj" (UID: "7e5fe73f-5e92-40f3-ac32-9300d24d5102") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:39.693002 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:39.692965 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:39.693269 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.693245 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:39.693269 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.693269 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:39.693471 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.693300 2562 projected.go:196] Error preparing data for projected volume kube-api-access-247ws for pod openshift-network-diagnostics/network-check-target-vlqgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:39.693471 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.693368 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws podName:c0e07055-23d7-417e-9dbc-0b57355c8bd2 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:43.693348935 +0000 UTC m=+10.248369382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-247ws" (UniqueName: "kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws") pod "network-check-target-vlqgh" (UID: "c0e07055-23d7-417e-9dbc-0b57355c8bd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:39.914652 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:39.914575 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:39.914806 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.914703 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:39.915154 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:39.915130 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:39.915271 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.915246 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:39.915351 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:39.915307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:39.915476 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:39.915455 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:41.914877 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:41.914838 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:41.915465 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:41.914979 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:41.915465 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:41.914844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:41.915465 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:41.915132 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:41.915465 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:41.915225 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:41.915465 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:41.915331 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:43.525898 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:43.525864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:43.525898 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:43.525904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:43.526414 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.526013 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:43.526414 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.526030 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:43.526414 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.526083 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:51.526063545 +0000 UTC m=+18.081084043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:43.526414 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.526103 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret podName:7e5fe73f-5e92-40f3-ac32-9300d24d5102 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:51.526093441 +0000 UTC m=+18.081113890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret") pod "global-pull-secret-syncer-zdflj" (UID: "7e5fe73f-5e92-40f3-ac32-9300d24d5102") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:43.727102 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:43.727068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:43.727327 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.727273 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:43.727327 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.727293 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:43.727327 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.727305 2562 projected.go:196] Error preparing data for projected volume kube-api-access-247ws for pod openshift-network-diagnostics/network-check-target-vlqgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:43.727506 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.727362 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws podName:c0e07055-23d7-417e-9dbc-0b57355c8bd2 nodeName:}" failed. No retries permitted until 2026-06-08 19:33:51.72734481 +0000 UTC m=+18.282365255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-247ws" (UniqueName: "kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws") pod "network-check-target-vlqgh" (UID: "c0e07055-23d7-417e-9dbc-0b57355c8bd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:43.918536 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:43.918457 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:43.918889 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.918862 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:43.919006 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:43.918529 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:43.919191 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.919167 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:43.919191 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:43.918497 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:43.919327 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:43.919295 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:45.915667 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:45.915261 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:45.915667 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:45.915261 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:45.915667 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:45.915417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:45.915667 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:45.915406 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:45.915667 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:45.915544 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:45.915667 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:45.915642 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:47.914380 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:47.914340 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:47.914380 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:47.914371 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:47.914854 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:47.914340 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:47.914854 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:47.914496 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:47.914854 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:47.914626 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:47.914854 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:47.914702 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:49.915090 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:49.915054 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:49.915090 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:49.915085 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:49.915582 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:49.915055 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:49.915582 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:49.915193 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:49.915582 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:49.915271 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:49.915582 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:49.915374 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:51.586098 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:51.586062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:51.586098 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:51.586112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:51.586619 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.586240 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:51.586619 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.586322 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret podName:7e5fe73f-5e92-40f3-ac32-9300d24d5102 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:07.58630178 +0000 UTC m=+34.141322226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret") pod "global-pull-secret-syncer-zdflj" (UID: "7e5fe73f-5e92-40f3-ac32-9300d24d5102") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:33:51.586619 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.586245 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:51.586619 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.586381 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:07.586368434 +0000 UTC m=+34.141388879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:33:51.788847 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:51.788802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:51.789023 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.789003 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:33:51.789066 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.789028 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:33:51.789066 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.789038 2562 projected.go:196] Error preparing data for projected volume kube-api-access-247ws for pod openshift-network-diagnostics/network-check-target-vlqgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:51.789126 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.789088 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws podName:c0e07055-23d7-417e-9dbc-0b57355c8bd2 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:07.789075426 +0000 UTC m=+34.344095870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-247ws" (UniqueName: "kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws") pod "network-check-target-vlqgh" (UID: "c0e07055-23d7-417e-9dbc-0b57355c8bd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:33:51.914953 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:51.914837 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:51.915119 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:51.914837 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:51.915119 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:51.914995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:51.915119 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.914972 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:51.915119 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.915068 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:51.915307 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:51.915188 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:53.915424 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:53.915389 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:53.915916 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:53.915498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:53.915916 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:53.915520 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:53.915916 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:53.915627 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:53.915916 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:53.915656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:53.915916 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:53.915757 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:55.915583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:55.915313 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:55.916279 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:55.915688 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:55.916279 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:55.915313 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:55.916279 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:55.915783 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:55.916279 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:55.915370 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:55.916279 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:55.915873 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:56.000537 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.000462 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xbc4h" event={"ID":"3a09e5c9-6a4d-4261-8eaa-0df67a903e2e","Type":"ContainerStarted","Data":"2b11a84a91f876f6c6bab32802b4485a2cb0015fd3ccbaec715cc244da97a760"} Jun 08 19:33:56.001833 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.001812 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6mczp" event={"ID":"fbb3b0f1-d7e0-4173-acfc-09de2ea8371c","Type":"ContainerStarted","Data":"a6ee483b4d66c229a6cecee58451d2646ab76aa211d82580345d367324d76eb6"} Jun 08 19:33:56.004407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.004390 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:33:56.004744 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.004725 2562 generic.go:356] "Generic (PLEG): container finished" podID="9da1f431-17eb-41ab-8ecb-8da7f49ee78a" containerID="f94d113962e1f235c1640f3563f4b76ba42a4ad530524f720460529ad7c3761a" exitCode=1 Jun 08 19:33:56.004814 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.004793 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerStarted","Data":"3482fd3f758e3ef73c6ee051de1912fbf99cf5f32d57e7d27df5334a022195e1"} Jun 08 19:33:56.004887 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.004873 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerStarted","Data":"8bf72a45f80c5e3a928a10d0410b91e9162257886237ed184c53623725114720"} Jun 08 19:33:56.004944 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.004928 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerStarted","Data":"b64b240d9e2806968e17ad8e12d17b864538c8b4802162c261d217483e7ab1eb"} Jun 08 19:33:56.004994 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.004977 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerStarted","Data":"174f7cee7957726a0c4ab6c5038a06a653213a3df7c201c84483efe853aea056"} Jun 08 19:33:56.005047 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.005028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerDied","Data":"f94d113962e1f235c1640f3563f4b76ba42a4ad530524f720460529ad7c3761a"} Jun 08 19:33:56.005104 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.005084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerStarted","Data":"b3b055b60c422e86210e2d9ec389dda250e7ab863b79da976a69e11a9503e873"} Jun 08 19:33:56.006154 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.006135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9hfwf" event={"ID":"aef26922-f1bc-4db5-ad6d-89ac2e3adea4","Type":"ContainerStarted","Data":"75ddc52ca5723490c4abc31c770d11e276b042ad973e858d22120ac4241aad52"} Jun 08 19:33:56.007485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.007464 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jpmc9" event={"ID":"efb93724-6f1a-4fd3-aa24-3b59d27a4d90","Type":"ContainerStarted","Data":"bb983dee730f943b30dfff9e27e35545199866fd75cff998b0c51489ba4a0e9a"} Jun 08 19:33:56.008779 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.008758 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h5k5x" event={"ID":"11999dd3-1fdf-4bcf-92c3-93be6cf1218c","Type":"ContainerStarted","Data":"6a57748d41320f9cd24c52c3d8026ba1e688a72bdcd267967f7cfc54a202abec"} Jun 08 19:33:56.010046 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.010028 2562 generic.go:356] "Generic (PLEG): container finished" podID="b3a8a391-600f-44b4-a0be-54684c9ad5d2" containerID="124d08c050ab6042813f6a8c0534d76c9d9c36e229b64d722085ef4af4a0e73f" exitCode=0 Jun 08 19:33:56.010130 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.010086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" event={"ID":"b3a8a391-600f-44b4-a0be-54684c9ad5d2","Type":"ContainerDied","Data":"124d08c050ab6042813f6a8c0534d76c9d9c36e229b64d722085ef4af4a0e73f"} Jun 08 19:33:56.011450 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.011387 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" event={"ID":"be2d95f4-add9-4aaf-be17-2c62db32ad59","Type":"ContainerStarted","Data":"5cc6c4f7f938d7766e150a22014df005a4e4b7f1d5fb8a0478c0143a1e8fab5e"} Jun 08 19:33:56.016995 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.016958 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xbc4h" podStartSLOduration=4.015699973 podStartE2EDuration="22.016946516s" totalImagesPullingTime="18.001246543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:56.016557847 +0000 UTC m=+22.571578312" watchObservedRunningTime="2026-06-08 19:33:56.016946516 +0000 UTC m=+22.571966982" Jun 08 19:33:56.017122 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.017022 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" podStartSLOduration=21.017017017 podStartE2EDuration="21.017017017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:37.982909083 +0000 UTC m=+4.537929570" watchObservedRunningTime="2026-06-08 19:33:56.017017017 +0000 UTC m=+22.572037483" Jun 08 19:33:56.031678 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.031631 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9hfwf" podStartSLOduration=4.03106172 podStartE2EDuration="22.031616282s" totalImagesPullingTime="18.000554562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:56.031401535 +0000 UTC m=+22.586422001" watchObservedRunningTime="2026-06-08 19:33:56.031616282 +0000 UTC m=+22.586636745" Jun 08 19:33:56.048805 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.048750 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jpmc9" podStartSLOduration=3.658580877 podStartE2EDuration="22.048734465s" totalImagesPullingTime="18.390153588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:56.048470607 +0000 UTC m=+22.603491069" watchObservedRunningTime="2026-06-08 19:33:56.048734465 +0000 UTC m=+22.603754932" Jun 08 19:33:56.087448 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.087381 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6mczp" podStartSLOduration=3.747689002 podStartE2EDuration="22.087366686s" totalImagesPullingTime="18.339677684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:56.087015741 +0000 UTC m=+22.642036208" watchObservedRunningTime="2026-06-08 19:33:56.087366686 +0000 UTC m=+22.642387149" Jun 08 19:33:56.103836 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.103793 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h5k5x" podStartSLOduration=8.34881789 podStartE2EDuration="22.103776514s" totalImagesPullingTime="13.754958624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:56.103609689 +0000 UTC m=+22.658630169" watchObservedRunningTime="2026-06-08 19:33:56.103776514 +0000 UTC m=+22.658796980" Jun 08 19:33:56.365082 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.365059 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 19:33:56.914726 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.914604 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T19:33:56.365076305Z","UUID":"88ea935a-63da-41c8-8ad5-f349e745b790","Handler":null,"Name":"","Endpoint":""} Jun 08 19:33:56.916257 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.916228 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 19:33:56.916870 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:56.916267 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 19:33:57.016785 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:57.016748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" event={"ID":"be2d95f4-add9-4aaf-be17-2c62db32ad59","Type":"ContainerStarted","Data":"240654f90b6f0e07e78cc290f42bf63bfd670cc28a84fa2c095db7b35c49311f"} Jun 08 19:33:57.018515 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:57.018482 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sx9xl" event={"ID":"b26faca9-364e-47dd-86e2-45e634f2353e","Type":"ContainerStarted","Data":"47bba1ad961a3a852ace05c011824fc3907d92c1ce26e18eafa22154d5022dad"} Jun 08 19:33:57.036739 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:57.036679 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sx9xl" podStartSLOduration=4.687220043 podStartE2EDuration="23.0366564s" totalImagesPullingTime="18.349436357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:57.036483208 +0000 UTC m=+23.591503672" watchObservedRunningTime="2026-06-08 19:33:57.0366564 +0000 UTC m=+23.591676868" Jun 08 19:33:57.914420 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:57.914366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:57.914584 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:57.914562 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:57.914670 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:57.914649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:57.914783 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:57.914764 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:33:57.914848 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:57.914368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:57.914897 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:57.914855 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:57.922715 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:57.922691 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:57.923294 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:57.923276 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:58.024772 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:58.024741 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:33:58.025292 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:58.025257 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerStarted","Data":"f1741d634042f0edb08a9a17eee161f1f79543f1d565167ea7abdfc8bd28bc94"} Jun 08 19:33:58.027655 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:58.027628 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" event={"ID":"be2d95f4-add9-4aaf-be17-2c62db32ad59","Type":"ContainerStarted","Data":"6bc3934673b0b6597c2ef30f67e6c04b5b550cdb53c64452b7ee35e96919ec00"} Jun 08 19:33:58.028077 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:58.028059 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:58.028560 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:58.028543 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h5k5x" Jun 08 19:33:58.046204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:58.046148 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftnh7" podStartSLOduration=4.154001361 podStartE2EDuration="24.046127409s" totalImagesPullingTime="19.892126048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:33:58.045850135 +0000 UTC m=+24.600870602" watchObservedRunningTime="2026-06-08 19:33:58.046127409 +0000 UTC m=+24.601147877" Jun 08 19:33:59.915292 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:59.915099 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:33:59.915776 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:59.915098 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:33:59.915776 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:59.915405 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:33:59.915776 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:33:59.915130 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:33:59.915776 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:59.915488 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:33:59.915776 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:33:59.915544 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:34:01.037233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:01.037213 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:34:01.037617 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:01.037570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerStarted","Data":"0d6c432435a88eb77a0e8b2fa82b802e7fd5b32b7d0d1cfc182cab4b4ba0168c"} Jun 08 19:34:01.037879 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:01.037825 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:34:01.038015 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:01.037999 2562 scope.go:117] "RemoveContainer" containerID="f94d113962e1f235c1640f3563f4b76ba42a4ad530524f720460529ad7c3761a" Jun 08 19:34:01.054907 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:01.054884 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:34:01.914569 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:01.914537 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:34:01.914783 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:01.914537 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:34:01.914783 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:01.914643 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:34:01.914783 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:01.914537 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:01.914783 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:01.914717 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:34:01.914946 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:01.914806 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:34:02.045740 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.045645 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:34:02.046196 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.046146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" event={"ID":"9da1f431-17eb-41ab-8ecb-8da7f49ee78a","Type":"ContainerStarted","Data":"650ababf57c4806ac25d75cf583a0d86b21de5dbc5ec11a4aa02d90954d82673"} Jun 08 19:34:02.047559 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.047531 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:34:02.047679 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.047622 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:34:02.051199 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.051052 2562 generic.go:356] "Generic (PLEG): container finished" podID="b3a8a391-600f-44b4-a0be-54684c9ad5d2" containerID="fd35a4096761e588797a6f3f81c83f3c7520285f76753de468351733bcdce6cf" exitCode=0 Jun 08 19:34:02.051199 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.051087 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" event={"ID":"b3a8a391-600f-44b4-a0be-54684c9ad5d2","Type":"ContainerDied","Data":"fd35a4096761e588797a6f3f81c83f3c7520285f76753de468351733bcdce6cf"} Jun 08 19:34:02.065379 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.065354 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:34:02.077470 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.077392 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" podStartSLOduration=9.65503158 podStartE2EDuration="28.077377905s" totalImagesPullingTime="18.422346325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:34:02.075851787 +0000 UTC m=+28.630872254" watchObservedRunningTime="2026-06-08 19:34:02.077377905 +0000 UTC m=+28.632398370" Jun 08 19:34:02.716961 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.716930 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qp7m"] Jun 08 19:34:02.717104 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.717092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:34:02.717223 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:02.717196 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:34:02.721056 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.721020 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vlqgh"] Jun 08 19:34:02.721380 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.721353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:02.721522 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:02.721500 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:34:02.721880 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.721855 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdflj"] Jun 08 19:34:02.721977 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:02.721964 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:34:02.722114 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:02.722086 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:34:03.055557 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:03.055466 2562 generic.go:356] "Generic (PLEG): container finished" podID="b3a8a391-600f-44b4-a0be-54684c9ad5d2" containerID="09829862b9596b28174a095a0925cfa56a0f6565e5c84624f1c4e3c80c0d2bb8" exitCode=0 Jun 08 19:34:03.056383 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:03.055555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" event={"ID":"b3a8a391-600f-44b4-a0be-54684c9ad5d2","Type":"ContainerDied","Data":"09829862b9596b28174a095a0925cfa56a0f6565e5c84624f1c4e3c80c0d2bb8"} Jun 08 19:34:04.063740 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:04.063707 2562 generic.go:356] "Generic (PLEG): container finished" podID="b3a8a391-600f-44b4-a0be-54684c9ad5d2" containerID="ba373578e4e5caecaabe6dd26114296ca7450b80d4b43c8f94bc1206642dfd43" exitCode=0 Jun 08 19:34:04.064048 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:04.063786 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" event={"ID":"b3a8a391-600f-44b4-a0be-54684c9ad5d2","Type":"ContainerDied","Data":"ba373578e4e5caecaabe6dd26114296ca7450b80d4b43c8f94bc1206642dfd43"} Jun 08 19:34:04.915543 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:04.915302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:04.915719 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:04.915302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:34:04.915719 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:04.915638 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:34:04.915847 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:04.915737 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:34:04.915847 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:04.915390 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:34:04.915924 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:04.915845 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:34:06.914952 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:06.914923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:34:06.915451 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:06.915054 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:06.915451 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:06.915062 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:34:06.915451 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:06.915084 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:34:06.915451 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:06.915162 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vlqgh" podUID="c0e07055-23d7-417e-9dbc-0b57355c8bd2" Jun 08 19:34:06.915451 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:06.915244 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdflj" podUID="7e5fe73f-5e92-40f3-ac32-9300d24d5102" Jun 08 19:34:07.603200 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.603157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:34:07.603383 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:07.603282 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 19:34:07.603383 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.603291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:34:07.603383 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:07.603359 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret podName:7e5fe73f-5e92-40f3-ac32-9300d24d5102 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:39.603337566 +0000 UTC m=+66.158358012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret") pod "global-pull-secret-syncer-zdflj" (UID: "7e5fe73f-5e92-40f3-ac32-9300d24d5102") : object "kube-system"/"original-pull-secret" not registered Jun 08 19:34:07.603383 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:07.603376 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:34:07.603610 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:07.603453 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:39.603417577 +0000 UTC m=+66.158438026 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 19:34:07.765972 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.765943 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeReady" Jun 08 19:34:07.766170 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.766094 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 19:34:07.804442 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.804390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:07.804623 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:07.804543 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 19:34:07.804623 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:07.804567 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 19:34:07.804623 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:07.804581 2562 projected.go:196] Error preparing data for projected volume kube-api-access-247ws for pod openshift-network-diagnostics/network-check-target-vlqgh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:34:07.804792 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:07.804644 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws podName:c0e07055-23d7-417e-9dbc-0b57355c8bd2 nodeName:}" failed. No retries permitted until 2026-06-08 19:34:39.804627803 +0000 UTC m=+66.359648246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-247ws" (UniqueName: "kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws") pod "network-check-target-vlqgh" (UID: "c0e07055-23d7-417e-9dbc-0b57355c8bd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 19:34:07.812962 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.812931 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8cxxj"] Jun 08 19:34:07.833148 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.833116 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z45f2"] Jun 08 19:34:07.833329 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.833236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:07.835875 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.835846 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 19:34:07.836006 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.835902 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dhlvj\"" Jun 08 19:34:07.836295 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.836275 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 19:34:07.853192 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.852986 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8cxxj"] Jun 08 19:34:07.853739 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.853670 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z45f2"] Jun 08 19:34:07.853848 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.853788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z45f2" Jun 08 19:34:07.856328 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.856301 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 19:34:07.856328 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.856331 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 19:34:07.856500 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.856353 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 19:34:07.856500 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.856359 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7jbdc\"" Jun 08 19:34:07.905642 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.905605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:07.905804 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.905676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39b49e66-5334-4ffb-926b-dad8d5d0f42a-config-volume\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:07.905804 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.905698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b49e66-5334-4ffb-926b-dad8d5d0f42a-tmp-dir\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:07.905804 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:07.905733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p78nm\" (UniqueName: \"kubernetes.io/projected/39b49e66-5334-4ffb-926b-dad8d5d0f42a-kube-api-access-p78nm\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:08.007016 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.006981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74th7\" (UniqueName: \"kubernetes.io/projected/5dbb6b86-bd1d-4e2d-a79c-cf524764b62a-kube-api-access-74th7\") pod \"ingress-canary-z45f2\" (UID: \"5dbb6b86-bd1d-4e2d-a79c-cf524764b62a\") " pod="openshift-ingress-canary/ingress-canary-z45f2" Jun 08 19:34:08.007423 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.007033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39b49e66-5334-4ffb-926b-dad8d5d0f42a-config-volume\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:08.007423 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.007058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b49e66-5334-4ffb-926b-dad8d5d0f42a-tmp-dir\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:08.007423 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.007084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p78nm\" (UniqueName: \"kubernetes.io/projected/39b49e66-5334-4ffb-926b-dad8d5d0f42a-kube-api-access-p78nm\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:08.007423 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.007122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dbb6b86-bd1d-4e2d-a79c-cf524764b62a-cert\") pod \"ingress-canary-z45f2\" (UID: \"5dbb6b86-bd1d-4e2d-a79c-cf524764b62a\") " pod="openshift-ingress-canary/ingress-canary-z45f2" Jun 08 19:34:08.007423 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.007142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:08.007423 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:08.007245 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:08.007423 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:08.007310 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls podName:39b49e66-5334-4ffb-926b-dad8d5d0f42a nodeName:}" failed. No retries permitted until 2026-06-08 19:34:08.507292442 +0000 UTC m=+35.062312902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls") pod "dns-default-8cxxj" (UID: "39b49e66-5334-4ffb-926b-dad8d5d0f42a") : secret "dns-default-metrics-tls" not found Jun 08 19:34:08.007691 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.007449 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b49e66-5334-4ffb-926b-dad8d5d0f42a-tmp-dir\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:08.007731 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.007711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39b49e66-5334-4ffb-926b-dad8d5d0f42a-config-volume\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:08.020137 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.020111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p78nm\" (UniqueName: \"kubernetes.io/projected/39b49e66-5334-4ffb-926b-dad8d5d0f42a-kube-api-access-p78nm\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:08.107727 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.107654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dbb6b86-bd1d-4e2d-a79c-cf524764b62a-cert\") pod \"ingress-canary-z45f2\" (UID: \"5dbb6b86-bd1d-4e2d-a79c-cf524764b62a\") " pod="openshift-ingress-canary/ingress-canary-z45f2" Jun 08 19:34:08.107727 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.107708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74th7\" (UniqueName: \"kubernetes.io/projected/5dbb6b86-bd1d-4e2d-a79c-cf524764b62a-kube-api-access-74th7\") pod \"ingress-canary-z45f2\" (UID: \"5dbb6b86-bd1d-4e2d-a79c-cf524764b62a\") " pod="openshift-ingress-canary/ingress-canary-z45f2" Jun 08 19:34:08.110375 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.110350 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dbb6b86-bd1d-4e2d-a79c-cf524764b62a-cert\") pod \"ingress-canary-z45f2\" (UID: \"5dbb6b86-bd1d-4e2d-a79c-cf524764b62a\") " pod="openshift-ingress-canary/ingress-canary-z45f2" Jun 08 19:34:08.116338 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.116314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74th7\" (UniqueName: \"kubernetes.io/projected/5dbb6b86-bd1d-4e2d-a79c-cf524764b62a-kube-api-access-74th7\") pod \"ingress-canary-z45f2\" (UID: \"5dbb6b86-bd1d-4e2d-a79c-cf524764b62a\") " pod="openshift-ingress-canary/ingress-canary-z45f2" Jun 08 19:34:08.164312 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.164264 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z45f2" Jun 08 19:34:08.417590 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.417170 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z45f2"] Jun 08 19:34:08.419996 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:34:08.419969 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbb6b86_bd1d_4e2d_a79c_cf524764b62a.slice/crio-11821a10f9679dc4572655a552c86e4259c4ae523f6e0369f447118942f58802 WatchSource:0}: Error finding container 11821a10f9679dc4572655a552c86e4259c4ae523f6e0369f447118942f58802: Status 404 returned error can't find the container with id 11821a10f9679dc4572655a552c86e4259c4ae523f6e0369f447118942f58802 Jun 08 19:34:08.511125 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.511092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:08.511262 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:08.511230 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:08.511325 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:08.511295 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls podName:39b49e66-5334-4ffb-926b-dad8d5d0f42a nodeName:}" failed. No retries permitted until 2026-06-08 19:34:09.511278731 +0000 UTC m=+36.066299175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls") pod "dns-default-8cxxj" (UID: "39b49e66-5334-4ffb-926b-dad8d5d0f42a") : secret "dns-default-metrics-tls" not found Jun 08 19:34:08.914484 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.914445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:08.914782 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.914445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:34:08.914782 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.914449 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:34:08.917885 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.917864 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ntgfs\"" Jun 08 19:34:08.918100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.917891 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:34:08.919072 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.919052 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 19:34:08.919072 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.919068 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 19:34:08.919233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.919075 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kkkgg\"" Jun 08 19:34:08.919233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:08.919073 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:34:09.078365 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:09.078329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z45f2" event={"ID":"5dbb6b86-bd1d-4e2d-a79c-cf524764b62a","Type":"ContainerStarted","Data":"11821a10f9679dc4572655a552c86e4259c4ae523f6e0369f447118942f58802"} Jun 08 19:34:09.081025 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:09.080995 2562 generic.go:356] "Generic (PLEG): container finished" podID="b3a8a391-600f-44b4-a0be-54684c9ad5d2" containerID="ec15cde04c6b29abd36b9c13ea9f4f4c0dfa614f44a0e9bb93f4a490f6c85228" exitCode=0 Jun 08 19:34:09.081146 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:09.081036 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" event={"ID":"b3a8a391-600f-44b4-a0be-54684c9ad5d2","Type":"ContainerDied","Data":"ec15cde04c6b29abd36b9c13ea9f4f4c0dfa614f44a0e9bb93f4a490f6c85228"} Jun 08 19:34:09.519808 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:09.519724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:09.520030 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:09.519902 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:09.520030 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:09.519978 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls podName:39b49e66-5334-4ffb-926b-dad8d5d0f42a nodeName:}" failed. No retries permitted until 2026-06-08 19:34:11.519961302 +0000 UTC m=+38.074981745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls") pod "dns-default-8cxxj" (UID: "39b49e66-5334-4ffb-926b-dad8d5d0f42a") : secret "dns-default-metrics-tls" not found Jun 08 19:34:10.087527 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:10.087489 2562 generic.go:356] "Generic (PLEG): container finished" podID="b3a8a391-600f-44b4-a0be-54684c9ad5d2" containerID="0b9a0d1b62b7d7a42734bfe16d9efbc4a6357026ecc83184c8705561b5bc1654" exitCode=0 Jun 08 19:34:10.088148 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:10.087550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" event={"ID":"b3a8a391-600f-44b4-a0be-54684c9ad5d2","Type":"ContainerDied","Data":"0b9a0d1b62b7d7a42734bfe16d9efbc4a6357026ecc83184c8705561b5bc1654"} Jun 08 19:34:11.093923 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:11.093892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" event={"ID":"b3a8a391-600f-44b4-a0be-54684c9ad5d2","Type":"ContainerStarted","Data":"d6352e3fabdf9557ff9fd15086d864e5198679f17dca1daae51dcb35edf46e85"} Jun 08 19:34:11.095555 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:11.095530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z45f2" event={"ID":"5dbb6b86-bd1d-4e2d-a79c-cf524764b62a","Type":"ContainerStarted","Data":"4d61f845f69b31c52522dab3f0a912a9bb56c43950ff949a6b4c4a3eec761c56"} Jun 08 19:34:11.120246 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:11.120187 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xjfg4" podStartSLOduration=8.458447044 podStartE2EDuration="37.120172351s" totalImagesPullingTime="28.661725307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:34:11.118741473 +0000 UTC m=+37.673761959" watchObservedRunningTime="2026-06-08 19:34:11.120172351 +0000 UTC m=+37.675192808" Jun 08 19:34:11.135736 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:11.135691 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z45f2" podStartSLOduration=1.76022057 podStartE2EDuration="4.135674345s" totalImagesPullingTime="2.375453775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:34:11.134994155 +0000 UTC m=+37.690014644" watchObservedRunningTime="2026-06-08 19:34:11.135674345 +0000 UTC m=+37.690694807" Jun 08 19:34:11.535264 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:11.535175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:11.535412 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:11.535345 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:11.535475 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:11.535413 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls podName:39b49e66-5334-4ffb-926b-dad8d5d0f42a nodeName:}" failed. No retries permitted until 2026-06-08 19:34:15.535397366 +0000 UTC m=+42.090417810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls") pod "dns-default-8cxxj" (UID: "39b49e66-5334-4ffb-926b-dad8d5d0f42a") : secret "dns-default-metrics-tls" not found Jun 08 19:34:15.565415 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:15.565374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:15.565797 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:15.565535 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:15.565797 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:15.565599 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls podName:39b49e66-5334-4ffb-926b-dad8d5d0f42a nodeName:}" failed. No retries permitted until 2026-06-08 19:34:23.565584223 +0000 UTC m=+50.120604667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls") pod "dns-default-8cxxj" (UID: "39b49e66-5334-4ffb-926b-dad8d5d0f42a") : secret "dns-default-metrics-tls" not found Jun 08 19:34:17.178206 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.178173 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln"] Jun 08 19:34:17.209808 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.209777 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln"] Jun 08 19:34:17.209808 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.209808 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p"] Jun 08 19:34:17.209988 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.209905 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" Jun 08 19:34:17.212530 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.212507 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 19:34:17.213605 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.213588 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ctp2r\"" Jun 08 19:34:17.213719 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.213693 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 19:34:17.213719 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.213693 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 19:34:17.213815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.213695 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 19:34:17.223721 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.223700 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p"] Jun 08 19:34:17.223827 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.223796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.226019 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.225999 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 19:34:17.377003 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.376970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c89487df-1d1e-4d9f-a6b7-698e3d8f48c5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-89446bf44-r7kln\" (UID: \"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" Jun 08 19:34:17.377003 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.377010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/088e5a69-f868-4229-8599-7f75dbd5e66c-tmp\") pod \"klusterlet-addon-workmgr-85fcfdc7dd-rhs9p\" (UID: \"088e5a69-f868-4229-8599-7f75dbd5e66c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.377175 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.377029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/088e5a69-f868-4229-8599-7f75dbd5e66c-klusterlet-config\") pod \"klusterlet-addon-workmgr-85fcfdc7dd-rhs9p\" (UID: \"088e5a69-f868-4229-8599-7f75dbd5e66c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.377175 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.377110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zt7w\" (UniqueName: \"kubernetes.io/projected/c89487df-1d1e-4d9f-a6b7-698e3d8f48c5-kube-api-access-2zt7w\") pod \"managed-serviceaccount-addon-agent-89446bf44-r7kln\" (UID: \"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" Jun 08 19:34:17.377255 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.377171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz65c\" (UniqueName: \"kubernetes.io/projected/088e5a69-f868-4229-8599-7f75dbd5e66c-kube-api-access-sz65c\") pod \"klusterlet-addon-workmgr-85fcfdc7dd-rhs9p\" (UID: \"088e5a69-f868-4229-8599-7f75dbd5e66c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.478230 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.478142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c89487df-1d1e-4d9f-a6b7-698e3d8f48c5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-89446bf44-r7kln\" (UID: \"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" Jun 08 19:34:17.478230 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.478192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/088e5a69-f868-4229-8599-7f75dbd5e66c-tmp\") pod \"klusterlet-addon-workmgr-85fcfdc7dd-rhs9p\" (UID: \"088e5a69-f868-4229-8599-7f75dbd5e66c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.478230 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.478213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/088e5a69-f868-4229-8599-7f75dbd5e66c-klusterlet-config\") pod \"klusterlet-addon-workmgr-85fcfdc7dd-rhs9p\" (UID: \"088e5a69-f868-4229-8599-7f75dbd5e66c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.478510 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.478254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zt7w\" (UniqueName: \"kubernetes.io/projected/c89487df-1d1e-4d9f-a6b7-698e3d8f48c5-kube-api-access-2zt7w\") pod \"managed-serviceaccount-addon-agent-89446bf44-r7kln\" (UID: \"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" Jun 08 19:34:17.478510 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.478272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz65c\" (UniqueName: \"kubernetes.io/projected/088e5a69-f868-4229-8599-7f75dbd5e66c-kube-api-access-sz65c\") pod \"klusterlet-addon-workmgr-85fcfdc7dd-rhs9p\" (UID: \"088e5a69-f868-4229-8599-7f75dbd5e66c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.481453 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.481416 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c89487df-1d1e-4d9f-a6b7-698e3d8f48c5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-89446bf44-r7kln\" (UID: \"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" Jun 08 19:34:17.481556 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.481469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/088e5a69-f868-4229-8599-7f75dbd5e66c-klusterlet-config\") pod \"klusterlet-addon-workmgr-85fcfdc7dd-rhs9p\" (UID: \"088e5a69-f868-4229-8599-7f75dbd5e66c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.486695 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.486657 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz65c\" (UniqueName: \"kubernetes.io/projected/088e5a69-f868-4229-8599-7f75dbd5e66c-kube-api-access-sz65c\") pod \"klusterlet-addon-workmgr-85fcfdc7dd-rhs9p\" (UID: \"088e5a69-f868-4229-8599-7f75dbd5e66c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.486695 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.486676 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zt7w\" (UniqueName: \"kubernetes.io/projected/c89487df-1d1e-4d9f-a6b7-698e3d8f48c5-kube-api-access-2zt7w\") pod \"managed-serviceaccount-addon-agent-89446bf44-r7kln\" (UID: \"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" Jun 08 19:34:17.490197 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.490174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/088e5a69-f868-4229-8599-7f75dbd5e66c-tmp\") pod \"klusterlet-addon-workmgr-85fcfdc7dd-rhs9p\" (UID: \"088e5a69-f868-4229-8599-7f75dbd5e66c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.531570 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.531542 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" Jun 08 19:34:17.538708 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.538686 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:17.677700 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.677669 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln"] Jun 08 19:34:17.681254 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:34:17.681227 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc89487df_1d1e_4d9f_a6b7_698e3d8f48c5.slice/crio-d2277687158b0db4e6924679cab6d0bf82197b871410c73740c0e1a56f5a764d WatchSource:0}: Error finding container d2277687158b0db4e6924679cab6d0bf82197b871410c73740c0e1a56f5a764d: Status 404 returned error can't find the container with id d2277687158b0db4e6924679cab6d0bf82197b871410c73740c0e1a56f5a764d Jun 08 19:34:17.693887 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:17.693867 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p"] Jun 08 19:34:17.697724 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:34:17.697699 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088e5a69_f868_4229_8599_7f75dbd5e66c.slice/crio-c9acb00e2bea4be2f8a23528c5f314b37b800690cfa7239c1e65e8eb5f5d94d9 WatchSource:0}: Error finding container c9acb00e2bea4be2f8a23528c5f314b37b800690cfa7239c1e65e8eb5f5d94d9: Status 404 returned error can't find the container with id c9acb00e2bea4be2f8a23528c5f314b37b800690cfa7239c1e65e8eb5f5d94d9 Jun 08 19:34:18.113134 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:18.113100 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" event={"ID":"088e5a69-f868-4229-8599-7f75dbd5e66c","Type":"ContainerStarted","Data":"c9acb00e2bea4be2f8a23528c5f314b37b800690cfa7239c1e65e8eb5f5d94d9"} Jun 08 19:34:18.114133 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:18.114112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" event={"ID":"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5","Type":"ContainerStarted","Data":"d2277687158b0db4e6924679cab6d0bf82197b871410c73740c0e1a56f5a764d"} Jun 08 19:34:23.631309 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:23.631270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:23.631722 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:23.631385 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:23.631722 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:23.631458 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls podName:39b49e66-5334-4ffb-926b-dad8d5d0f42a nodeName:}" failed. No retries permitted until 2026-06-08 19:34:39.631422989 +0000 UTC m=+66.186443434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls") pod "dns-default-8cxxj" (UID: "39b49e66-5334-4ffb-926b-dad8d5d0f42a") : secret "dns-default-metrics-tls" not found Jun 08 19:34:24.132050 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:24.132014 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" event={"ID":"088e5a69-f868-4229-8599-7f75dbd5e66c","Type":"ContainerStarted","Data":"ce4332dfc73c10b53c390fb36be092308ed857a6b2a692b04d477f86bc178428"} Jun 08 19:34:24.132239 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:24.132165 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:24.133488 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:24.133466 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" event={"ID":"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5","Type":"ContainerStarted","Data":"e106628e5b133359654c9524e84e2773d6a5ba546e3addf092c4f9ab5a090fa7"} Jun 08 19:34:24.133659 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:24.133644 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:34:24.149704 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:24.149652 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" podStartSLOduration=1.709568464 podStartE2EDuration="7.149639952s" totalImagesPullingTime="5.440071488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:34:24.148828326 +0000 UTC m=+50.703848792" watchObservedRunningTime="2026-06-08 19:34:24.149639952 +0000 UTC m=+50.704660418" Jun 08 19:34:24.166966 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:24.166914 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" podStartSLOduration=1.7063079509999999 podStartE2EDuration="7.166900534s" totalImagesPullingTime="5.460592583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:34:24.166108381 +0000 UTC m=+50.721128843" watchObservedRunningTime="2026-06-08 19:34:24.166900534 +0000 UTC m=+50.721920978" Jun 08 19:34:34.074284 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:34.074258 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkpqb" Jun 08 19:34:39.643820 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.643784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:34:39.644224 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.643837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:34:39.644224 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.643884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:34:39.644224 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:39.643992 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:34:39.644224 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:39.644059 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls podName:39b49e66-5334-4ffb-926b-dad8d5d0f42a nodeName:}" failed. No retries permitted until 2026-06-08 19:35:11.644043045 +0000 UTC m=+98.199063495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls") pod "dns-default-8cxxj" (UID: "39b49e66-5334-4ffb-926b-dad8d5d0f42a") : secret "dns-default-metrics-tls" not found Jun 08 19:34:39.646720 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.646698 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 19:34:39.646813 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.646719 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 19:34:39.654283 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:39.654259 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:34:39.654404 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:34:39.654336 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:35:43.65431393 +0000 UTC m=+130.209334377 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : secret "metrics-daemon-secret" not found Jun 08 19:34:39.656419 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.656396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e5fe73f-5e92-40f3-ac32-9300d24d5102-original-pull-secret\") pod \"global-pull-secret-syncer-zdflj\" (UID: \"7e5fe73f-5e92-40f3-ac32-9300d24d5102\") " pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:34:39.843174 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.843131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdflj" Jun 08 19:34:39.845492 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.845470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:39.848380 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.848354 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 19:34:39.858073 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.858054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 19:34:39.868441 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:39.868408 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-247ws\" (UniqueName: \"kubernetes.io/projected/c0e07055-23d7-417e-9dbc-0b57355c8bd2-kube-api-access-247ws\") pod \"network-check-target-vlqgh\" (UID: \"c0e07055-23d7-417e-9dbc-0b57355c8bd2\") " pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:40.007980 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:40.007941 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdflj"] Jun 08 19:34:40.010660 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:34:40.010629 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5fe73f_5e92_40f3_ac32_9300d24d5102.slice/crio-f956b682390424a5ca2b196297dcce396cea89e9c151fd24269608f0a80d9e73 WatchSource:0}: Error finding container f956b682390424a5ca2b196297dcce396cea89e9c151fd24269608f0a80d9e73: Status 404 returned error can't find the container with id f956b682390424a5ca2b196297dcce396cea89e9c151fd24269608f0a80d9e73 Jun 08 19:34:40.128028 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:40.127996 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ntgfs\"" Jun 08 19:34:40.136347 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:40.136330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:40.173004 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:40.172973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdflj" event={"ID":"7e5fe73f-5e92-40f3-ac32-9300d24d5102","Type":"ContainerStarted","Data":"f956b682390424a5ca2b196297dcce396cea89e9c151fd24269608f0a80d9e73"} Jun 08 19:34:40.285115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:40.285085 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vlqgh"] Jun 08 19:34:40.288117 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:34:40.288089 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e07055_23d7_417e_9dbc_0b57355c8bd2.slice/crio-ea6d0de174080884ef8b1e880ed50a39cc48b942b5c824b7339e35f0ded40d45 WatchSource:0}: Error finding container ea6d0de174080884ef8b1e880ed50a39cc48b942b5c824b7339e35f0ded40d45: Status 404 returned error can't find the container with id ea6d0de174080884ef8b1e880ed50a39cc48b942b5c824b7339e35f0ded40d45 Jun 08 19:34:41.177464 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:41.177397 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vlqgh" event={"ID":"c0e07055-23d7-417e-9dbc-0b57355c8bd2","Type":"ContainerStarted","Data":"ea6d0de174080884ef8b1e880ed50a39cc48b942b5c824b7339e35f0ded40d45"} Jun 08 19:34:44.185958 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:44.185921 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vlqgh" event={"ID":"c0e07055-23d7-417e-9dbc-0b57355c8bd2","Type":"ContainerStarted","Data":"a4937bf38016563caf44b0ec9626f9eeb74a5a56692420a9ee6c851770160790"} Jun 08 19:34:44.186404 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:44.186133 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:34:44.204784 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:44.204720 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vlqgh" podStartSLOduration=67.360422861 podStartE2EDuration="1m10.204699292s" totalImagesPullingTime="2.844276431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:34:44.203444652 +0000 UTC m=+70.758465112" watchObservedRunningTime="2026-06-08 19:34:44.204699292 +0000 UTC m=+70.759719769" Jun 08 19:34:46.193176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:46.193139 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdflj" event={"ID":"7e5fe73f-5e92-40f3-ac32-9300d24d5102","Type":"ContainerStarted","Data":"465f3db3bf127c77038be88b06bcfb0e52c19d14594bc1c8763c1edca3910adf"} Jun 08 19:34:46.211842 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:34:46.211789 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zdflj" podStartSLOduration=66.811382996 podStartE2EDuration="1m12.211773923s" totalImagesPullingTime="5.400390927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:34:46.211381098 +0000 UTC m=+72.766401565" watchObservedRunningTime="2026-06-08 19:34:46.211773923 +0000 UTC m=+72.766794417" Jun 08 19:35:11.665784 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:35:11.665733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:35:11.666213 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:35:11.665883 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:35:11.666213 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:35:11.665936 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls podName:39b49e66-5334-4ffb-926b-dad8d5d0f42a nodeName:}" failed. No retries permitted until 2026-06-08 19:36:15.665922942 +0000 UTC m=+162.220943386 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls") pod "dns-default-8cxxj" (UID: "39b49e66-5334-4ffb-926b-dad8d5d0f42a") : secret "dns-default-metrics-tls" not found Jun 08 19:35:15.191144 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:35:15.191113 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vlqgh" Jun 08 19:35:43.676687 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:35:43.676634 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:35:43.677177 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:35:43.676799 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:35:43.677177 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:35:43.676865 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:37:45.676849801 +0000 UTC m=+252.231870248 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : secret "metrics-daemon-secret" not found Jun 08 19:36:10.844839 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:36:10.844789 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8cxxj" podUID="39b49e66-5334-4ffb-926b-dad8d5d0f42a" Jun 08 19:36:11.434603 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:11.434571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8cxxj" Jun 08 19:36:11.933196 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:36:11.933163 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:36:15.696626 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:15.696536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:36:15.697016 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:36:15.696699 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 19:36:15.697016 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:36:15.696764 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls podName:39b49e66-5334-4ffb-926b-dad8d5d0f42a nodeName:}" failed. No retries permitted until 2026-06-08 19:38:17.696747226 +0000 UTC m=+284.251767672 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls") pod "dns-default-8cxxj" (UID: "39b49e66-5334-4ffb-926b-dad8d5d0f42a") : secret "dns-default-metrics-tls" not found Jun 08 19:36:23.467920 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:23.467888 2562 generic.go:356] "Generic (PLEG): container finished" podID="c89487df-1d1e-4d9f-a6b7-698e3d8f48c5" containerID="e106628e5b133359654c9524e84e2773d6a5ba546e3addf092c4f9ab5a090fa7" exitCode=255 Jun 08 19:36:23.468359 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:23.467963 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" event={"ID":"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5","Type":"ContainerDied","Data":"e106628e5b133359654c9524e84e2773d6a5ba546e3addf092c4f9ab5a090fa7"} Jun 08 19:36:23.469642 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:23.469613 2562 generic.go:356] "Generic (PLEG): container finished" podID="088e5a69-f868-4229-8599-7f75dbd5e66c" containerID="ce4332dfc73c10b53c390fb36be092308ed857a6b2a692b04d477f86bc178428" exitCode=1 Jun 08 19:36:23.469749 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:23.469644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" event={"ID":"088e5a69-f868-4229-8599-7f75dbd5e66c","Type":"ContainerDied","Data":"ce4332dfc73c10b53c390fb36be092308ed857a6b2a692b04d477f86bc178428"} Jun 08 19:36:23.469922 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:23.469910 2562 scope.go:117] "RemoveContainer" containerID="ce4332dfc73c10b53c390fb36be092308ed857a6b2a692b04d477f86bc178428" Jun 08 19:36:23.474288 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:23.474274 2562 scope.go:117] "RemoveContainer" containerID="e106628e5b133359654c9524e84e2773d6a5ba546e3addf092c4f9ab5a090fa7" Jun 08 19:36:24.132616 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:24.132565 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:36:24.473796 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:24.473699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" event={"ID":"088e5a69-f868-4229-8599-7f75dbd5e66c","Type":"ContainerStarted","Data":"6484c963276fb84729e0855c680c7bd4455097e608429cee9e39ab0444bd0d6e"} Jun 08 19:36:24.474256 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:24.473903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:36:24.474560 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:24.474537 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:36:24.477609 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:24.477578 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" event={"ID":"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5","Type":"ContainerStarted","Data":"b93f4f59ddd0da724551896f22f4181a580b727085a632f88ad6de91e7078458"} Jun 08 19:36:24.914843 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:36:24.914799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:37:35.818227 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.818185 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88"] Jun 08 19:37:35.820294 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.820271 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-fbczw"] Jun 08 19:37:35.820420 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.820389 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:35.822051 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.822032 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:35.823128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.823110 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 19:37:35.823228 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.823128 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 19:37:35.823228 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.823164 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pgp7h\"" Jun 08 19:37:35.823341 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.823232 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:37:35.823341 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.823304 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 19:37:35.824607 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.824591 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 19:37:35.824910 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.824892 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 19:37:35.825130 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.825110 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kzmzv\"" Jun 08 19:37:35.825398 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.825379 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 19:37:35.825863 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.825841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 19:37:35.829843 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.829823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 19:37:35.832792 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.832769 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88"] Jun 08 19:37:35.834789 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.834770 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-fbczw"] Jun 08 19:37:35.908734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.908706 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw"] Jun 08 19:37:35.910650 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.910629 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:35.911864 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.911842 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9qhqx"] Jun 08 19:37:35.913108 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.913078 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 19:37:35.913209 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.913111 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 19:37:35.913209 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.913120 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 19:37:35.913209 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.913136 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-t7685\"" Jun 08 19:37:35.913391 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.913258 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:37:35.913535 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.913521 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:35.915773 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.915752 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-c7tv8\"" Jun 08 19:37:35.915896 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.915829 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:37:35.916013 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.915996 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 08 19:37:35.916451 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.916410 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 08 19:37:35.916787 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.916765 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 08 19:37:35.921054 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.921032 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 08 19:37:35.921415 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.921393 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw"] Jun 08 19:37:35.927387 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.927362 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9qhqx"] Jun 08 19:37:35.967899 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.967868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a49d924-67c1-4f3c-bfd5-d296abb7196d-snapshots\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:35.967899 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.967902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a49d924-67c1-4f3c-bfd5-d296abb7196d-serving-cert\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:35.968128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.967920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pfrh\" (UniqueName: \"kubernetes.io/projected/3a49d924-67c1-4f3c-bfd5-d296abb7196d-kube-api-access-8pfrh\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:35.968128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.967937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9e47502-94b5-4a0f-8159-cc3f8ea5b23a-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lzr88\" (UID: \"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:35.968128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.967960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqzfc\" (UniqueName: \"kubernetes.io/projected/f9e47502-94b5-4a0f-8159-cc3f8ea5b23a-kube-api-access-hqzfc\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lzr88\" (UID: \"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:35.968128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.967986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a49d924-67c1-4f3c-bfd5-d296abb7196d-trusted-ca-bundle\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:35.968128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.968065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a49d924-67c1-4f3c-bfd5-d296abb7196d-tmp\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:35.968128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.968095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a49d924-67c1-4f3c-bfd5-d296abb7196d-service-ca-bundle\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:35.968128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:35.968126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9e47502-94b5-4a0f-8159-cc3f8ea5b23a-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lzr88\" (UID: \"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:36.068763 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a49d924-67c1-4f3c-bfd5-d296abb7196d-serving-cert\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.068763 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9e47502-94b5-4a0f-8159-cc3f8ea5b23a-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lzr88\" (UID: \"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:36.068763 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068752 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a49d924-67c1-4f3c-bfd5-d296abb7196d-tmp\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.069031 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a49d924-67c1-4f3c-bfd5-d296abb7196d-service-ca-bundle\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.069031 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eecda70f-18fd-4432-bc6c-fb293c150cdc-serving-cert\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.069031 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068837 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6rzj\" (UniqueName: \"kubernetes.io/projected/eecda70f-18fd-4432-bc6c-fb293c150cdc-kube-api-access-k6rzj\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.069031 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ded5d224-43e6-4e02-a2b2-85ab7ba7149b-config\") pod \"service-ca-operator-6bc5ff68f5-znflw\" (UID: \"ded5d224-43e6-4e02-a2b2-85ab7ba7149b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.069031 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glb5q\" (UniqueName: \"kubernetes.io/projected/ded5d224-43e6-4e02-a2b2-85ab7ba7149b-kube-api-access-glb5q\") pod \"service-ca-operator-6bc5ff68f5-znflw\" (UID: \"ded5d224-43e6-4e02-a2b2-85ab7ba7149b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.069031 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a49d924-67c1-4f3c-bfd5-d296abb7196d-snapshots\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.069031 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.068987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqzfc\" (UniqueName: \"kubernetes.io/projected/f9e47502-94b5-4a0f-8159-cc3f8ea5b23a-kube-api-access-hqzfc\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lzr88\" (UID: \"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:36.069031 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pfrh\" (UniqueName: \"kubernetes.io/projected/3a49d924-67c1-4f3c-bfd5-d296abb7196d-kube-api-access-8pfrh\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.069462 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eecda70f-18fd-4432-bc6c-fb293c150cdc-trusted-ca\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.069462 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069086 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9e47502-94b5-4a0f-8159-cc3f8ea5b23a-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lzr88\" (UID: \"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:36.069462 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eecda70f-18fd-4432-bc6c-fb293c150cdc-config\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.069462 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ded5d224-43e6-4e02-a2b2-85ab7ba7149b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-znflw\" (UID: \"ded5d224-43e6-4e02-a2b2-85ab7ba7149b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.069462 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a49d924-67c1-4f3c-bfd5-d296abb7196d-trusted-ca-bundle\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.069462 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069289 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a49d924-67c1-4f3c-bfd5-d296abb7196d-tmp\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.069462 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069388 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9e47502-94b5-4a0f-8159-cc3f8ea5b23a-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lzr88\" (UID: \"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:36.069817 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a49d924-67c1-4f3c-bfd5-d296abb7196d-service-ca-bundle\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.069817 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.069621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a49d924-67c1-4f3c-bfd5-d296abb7196d-snapshots\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.070130 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.070107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a49d924-67c1-4f3c-bfd5-d296abb7196d-trusted-ca-bundle\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.071199 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.071174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a49d924-67c1-4f3c-bfd5-d296abb7196d-serving-cert\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.071491 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.071475 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9e47502-94b5-4a0f-8159-cc3f8ea5b23a-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lzr88\" (UID: \"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:36.077307 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.077276 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pfrh\" (UniqueName: \"kubernetes.io/projected/3a49d924-67c1-4f3c-bfd5-d296abb7196d-kube-api-access-8pfrh\") pod \"insights-operator-896549976-fbczw\" (UID: \"3a49d924-67c1-4f3c-bfd5-d296abb7196d\") " pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.077307 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.077297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqzfc\" (UniqueName: \"kubernetes.io/projected/f9e47502-94b5-4a0f-8159-cc3f8ea5b23a-kube-api-access-hqzfc\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lzr88\" (UID: \"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:36.131292 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.131253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" Jun 08 19:37:36.137071 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.137048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-fbczw" Jun 08 19:37:36.170204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.170100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eecda70f-18fd-4432-bc6c-fb293c150cdc-serving-cert\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.170204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.170154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6rzj\" (UniqueName: \"kubernetes.io/projected/eecda70f-18fd-4432-bc6c-fb293c150cdc-kube-api-access-k6rzj\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.170204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.170203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ded5d224-43e6-4e02-a2b2-85ab7ba7149b-config\") pod \"service-ca-operator-6bc5ff68f5-znflw\" (UID: \"ded5d224-43e6-4e02-a2b2-85ab7ba7149b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.170531 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.170234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glb5q\" (UniqueName: \"kubernetes.io/projected/ded5d224-43e6-4e02-a2b2-85ab7ba7149b-kube-api-access-glb5q\") pod \"service-ca-operator-6bc5ff68f5-znflw\" (UID: \"ded5d224-43e6-4e02-a2b2-85ab7ba7149b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.170531 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.170271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eecda70f-18fd-4432-bc6c-fb293c150cdc-trusted-ca\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.170531 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.170308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eecda70f-18fd-4432-bc6c-fb293c150cdc-config\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.170531 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.170334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ded5d224-43e6-4e02-a2b2-85ab7ba7149b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-znflw\" (UID: \"ded5d224-43e6-4e02-a2b2-85ab7ba7149b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.171336 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.170910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ded5d224-43e6-4e02-a2b2-85ab7ba7149b-config\") pod \"service-ca-operator-6bc5ff68f5-znflw\" (UID: \"ded5d224-43e6-4e02-a2b2-85ab7ba7149b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.171336 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.171049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eecda70f-18fd-4432-bc6c-fb293c150cdc-config\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.172144 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.171573 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eecda70f-18fd-4432-bc6c-fb293c150cdc-trusted-ca\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.173340 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.173275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eecda70f-18fd-4432-bc6c-fb293c150cdc-serving-cert\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.174003 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.173982 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ded5d224-43e6-4e02-a2b2-85ab7ba7149b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-znflw\" (UID: \"ded5d224-43e6-4e02-a2b2-85ab7ba7149b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.178830 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.178802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glb5q\" (UniqueName: \"kubernetes.io/projected/ded5d224-43e6-4e02-a2b2-85ab7ba7149b-kube-api-access-glb5q\") pod \"service-ca-operator-6bc5ff68f5-znflw\" (UID: \"ded5d224-43e6-4e02-a2b2-85ab7ba7149b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.179300 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.179275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6rzj\" (UniqueName: \"kubernetes.io/projected/eecda70f-18fd-4432-bc6c-fb293c150cdc-kube-api-access-k6rzj\") pod \"console-operator-668fdbf85c-9qhqx\" (UID: \"eecda70f-18fd-4432-bc6c-fb293c150cdc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.223059 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.222786 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" Jun 08 19:37:36.227000 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.226970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:36.268687 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.268605 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88"] Jun 08 19:37:36.272615 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:37:36.272588 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e47502_94b5_4a0f_8159_cc3f8ea5b23a.slice/crio-9946de8746ea42a09d744d30616add3fd7a4c7e0be2f3345c9ba4751c55fc481 WatchSource:0}: Error finding container 9946de8746ea42a09d744d30616add3fd7a4c7e0be2f3345c9ba4751c55fc481: Status 404 returned error can't find the container with id 9946de8746ea42a09d744d30616add3fd7a4c7e0be2f3345c9ba4751c55fc481 Jun 08 19:37:36.286852 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.286793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-fbczw"] Jun 08 19:37:36.295663 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:37:36.295607 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a49d924_67c1_4f3c_bfd5_d296abb7196d.slice/crio-25356953a808c41e57a2608bef2c63ceea2eac0c126539a70136c0c25bff3d23 WatchSource:0}: Error finding container 25356953a808c41e57a2608bef2c63ceea2eac0c126539a70136c0c25bff3d23: Status 404 returned error can't find the container with id 25356953a808c41e57a2608bef2c63ceea2eac0c126539a70136c0c25bff3d23 Jun 08 19:37:36.371902 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.371784 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw"] Jun 08 19:37:36.374365 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:37:36.374341 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded5d224_43e6_4e02_a2b2_85ab7ba7149b.slice/crio-35a170aba9846bae282b3c6e51631b833ac7209f4b1a840534317911e73319cc WatchSource:0}: Error finding container 35a170aba9846bae282b3c6e51631b833ac7209f4b1a840534317911e73319cc: Status 404 returned error can't find the container with id 35a170aba9846bae282b3c6e51631b833ac7209f4b1a840534317911e73319cc Jun 08 19:37:36.385450 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.385406 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9qhqx"] Jun 08 19:37:36.387679 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:37:36.387656 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecda70f_18fd_4432_bc6c_fb293c150cdc.slice/crio-0f66123eec259f72094259ff0cb9ed72ec049edcf8dbd594f85bc8d550489633 WatchSource:0}: Error finding container 0f66123eec259f72094259ff0cb9ed72ec049edcf8dbd594f85bc8d550489633: Status 404 returned error can't find the container with id 0f66123eec259f72094259ff0cb9ed72ec049edcf8dbd594f85bc8d550489633 Jun 08 19:37:36.679492 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.679397 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" event={"ID":"eecda70f-18fd-4432-bc6c-fb293c150cdc","Type":"ContainerStarted","Data":"0f66123eec259f72094259ff0cb9ed72ec049edcf8dbd594f85bc8d550489633"} Jun 08 19:37:36.680346 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.680320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" event={"ID":"ded5d224-43e6-4e02-a2b2-85ab7ba7149b","Type":"ContainerStarted","Data":"35a170aba9846bae282b3c6e51631b833ac7209f4b1a840534317911e73319cc"} Jun 08 19:37:36.681261 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.681242 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fbczw" event={"ID":"3a49d924-67c1-4f3c-bfd5-d296abb7196d","Type":"ContainerStarted","Data":"25356953a808c41e57a2608bef2c63ceea2eac0c126539a70136c0c25bff3d23"} Jun 08 19:37:36.682140 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:36.682123 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" event={"ID":"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a","Type":"ContainerStarted","Data":"9946de8746ea42a09d744d30616add3fd7a4c7e0be2f3345c9ba4751c55fc481"} Jun 08 19:37:40.713275 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:40.713197 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fbczw" event={"ID":"3a49d924-67c1-4f3c-bfd5-d296abb7196d","Type":"ContainerStarted","Data":"eacb1276bbd99d73363c817b9366a9be09bcef76355d5e01de695433dd6c6391"} Jun 08 19:37:40.715150 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:40.715115 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" event={"ID":"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a","Type":"ContainerStarted","Data":"8f83487927c8ebc4031d6712bec4bff6e22927a4999147748f99d2285fc3ac20"} Jun 08 19:37:40.716745 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:40.716723 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/0.log" Jun 08 19:37:40.716852 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:40.716765 2562 generic.go:356] "Generic (PLEG): container finished" podID="eecda70f-18fd-4432-bc6c-fb293c150cdc" containerID="11bc8137097f91312d53545a051f43a8cda225c89f5cb60635b4579d118cc7b5" exitCode=255 Jun 08 19:37:40.716852 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:40.716836 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" event={"ID":"eecda70f-18fd-4432-bc6c-fb293c150cdc","Type":"ContainerDied","Data":"11bc8137097f91312d53545a051f43a8cda225c89f5cb60635b4579d118cc7b5"} Jun 08 19:37:40.717056 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:40.717039 2562 scope.go:117] "RemoveContainer" containerID="11bc8137097f91312d53545a051f43a8cda225c89f5cb60635b4579d118cc7b5" Jun 08 19:37:40.718264 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:40.718244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" event={"ID":"ded5d224-43e6-4e02-a2b2-85ab7ba7149b","Type":"ContainerStarted","Data":"1ec6ca062028aa62887800881ee32a6dad6b932836ba8cb4c704088b21b72d9c"} Jun 08 19:37:40.730683 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:40.730641 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-fbczw" podStartSLOduration=2.239973844 podStartE2EDuration="5.730625006s" totalImagesPullingTime="3.490651162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:37:40.729501992 +0000 UTC m=+247.284522478" watchObservedRunningTime="2026-06-08 19:37:40.730625006 +0000 UTC m=+247.285645451" Jun 08 19:37:40.744990 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:40.744934 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" podStartSLOduration=2.224928569 podStartE2EDuration="5.744912627s" totalImagesPullingTime="3.519984058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:37:40.744247666 +0000 UTC m=+247.299268133" watchObservedRunningTime="2026-06-08 19:37:40.744912627 +0000 UTC m=+247.299933094" Jun 08 19:37:41.027797 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.027695 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" podStartSLOduration=2.607568281 podStartE2EDuration="6.02767369s" totalImagesPullingTime="3.420105409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:37:40.776030406 +0000 UTC m=+247.331050874" watchObservedRunningTime="2026-06-08 19:37:41.02767369 +0000 UTC m=+247.582694158" Jun 08 19:37:41.028510 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.028493 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr"] Jun 08 19:37:41.030917 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.030896 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr" Jun 08 19:37:41.033566 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.033539 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 08 19:37:41.033672 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.033541 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 08 19:37:41.033672 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.033575 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6fs5t\"" Jun 08 19:37:41.040273 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.040248 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr"] Jun 08 19:37:41.112948 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.112906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6fnt\" (UniqueName: \"kubernetes.io/projected/74128e62-77db-4559-bb71-8fef731588af-kube-api-access-h6fnt\") pod \"migrator-955ffdf5f-nr4pr\" (UID: \"74128e62-77db-4559-bb71-8fef731588af\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr" Jun 08 19:37:41.214445 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.214374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6fnt\" (UniqueName: \"kubernetes.io/projected/74128e62-77db-4559-bb71-8fef731588af-kube-api-access-h6fnt\") pod \"migrator-955ffdf5f-nr4pr\" (UID: \"74128e62-77db-4559-bb71-8fef731588af\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr" Jun 08 19:37:41.223095 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.223029 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6fnt\" (UniqueName: \"kubernetes.io/projected/74128e62-77db-4559-bb71-8fef731588af-kube-api-access-h6fnt\") pod \"migrator-955ffdf5f-nr4pr\" (UID: \"74128e62-77db-4559-bb71-8fef731588af\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr" Jun 08 19:37:41.341615 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.341569 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr" Jun 08 19:37:41.469666 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.469278 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr"] Jun 08 19:37:41.471191 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:37:41.471166 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74128e62_77db_4559_bb71_8fef731588af.slice/crio-1f4dd52b5e4cb0327df086f92d2403f22b24bac36cfe9afdf0f101054c948c11 WatchSource:0}: Error finding container 1f4dd52b5e4cb0327df086f92d2403f22b24bac36cfe9afdf0f101054c948c11: Status 404 returned error can't find the container with id 1f4dd52b5e4cb0327df086f92d2403f22b24bac36cfe9afdf0f101054c948c11 Jun 08 19:37:41.722668 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.722594 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/1.log" Jun 08 19:37:41.723110 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.723023 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/0.log" Jun 08 19:37:41.723110 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.723067 2562 generic.go:356] "Generic (PLEG): container finished" podID="eecda70f-18fd-4432-bc6c-fb293c150cdc" containerID="a73c3de86186362b54a835c55402bad27e9cd1a70c9aa96ecff706b6b66cd263" exitCode=255 Jun 08 19:37:41.723221 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.723157 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" event={"ID":"eecda70f-18fd-4432-bc6c-fb293c150cdc","Type":"ContainerDied","Data":"a73c3de86186362b54a835c55402bad27e9cd1a70c9aa96ecff706b6b66cd263"} Jun 08 19:37:41.723221 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.723213 2562 scope.go:117] "RemoveContainer" containerID="11bc8137097f91312d53545a051f43a8cda225c89f5cb60635b4579d118cc7b5" Jun 08 19:37:41.723458 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.723420 2562 scope.go:117] "RemoveContainer" containerID="a73c3de86186362b54a835c55402bad27e9cd1a70c9aa96ecff706b6b66cd263" Jun 08 19:37:41.723657 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:37:41.723637 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9qhqx_openshift-console-operator(eecda70f-18fd-4432-bc6c-fb293c150cdc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" podUID="eecda70f-18fd-4432-bc6c-fb293c150cdc" Jun 08 19:37:41.725823 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:41.725797 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr" event={"ID":"74128e62-77db-4559-bb71-8fef731588af","Type":"ContainerStarted","Data":"1f4dd52b5e4cb0327df086f92d2403f22b24bac36cfe9afdf0f101054c948c11"} Jun 08 19:37:42.729768 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:42.729736 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/1.log" Jun 08 19:37:42.730228 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:42.730125 2562 scope.go:117] "RemoveContainer" containerID="a73c3de86186362b54a835c55402bad27e9cd1a70c9aa96ecff706b6b66cd263" Jun 08 19:37:42.730332 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:37:42.730311 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9qhqx_openshift-console-operator(eecda70f-18fd-4432-bc6c-fb293c150cdc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" podUID="eecda70f-18fd-4432-bc6c-fb293c150cdc" Jun 08 19:37:42.731646 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:42.731622 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr" event={"ID":"74128e62-77db-4559-bb71-8fef731588af","Type":"ContainerStarted","Data":"5e29650d2b3bfc05e1f70260ae10d27823198ac523c19db7d9498b06e96e6fb1"} Jun 08 19:37:42.731761 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:42.731663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr" event={"ID":"74128e62-77db-4559-bb71-8fef731588af","Type":"ContainerStarted","Data":"ed30c6313a4226123afc6018069a512b345902754bbaba463b1f76e3e795bc3f"} Jun 08 19:37:42.764767 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:42.764721 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nr4pr" podStartSLOduration=0.705387517 podStartE2EDuration="1.764704386s" totalImagesPullingTime="1.059316869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:37:42.763972305 +0000 UTC m=+249.318992781" watchObservedRunningTime="2026-06-08 19:37:42.764704386 +0000 UTC m=+249.319724852" Jun 08 19:37:44.151759 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:44.151727 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xbc4h_3a09e5c9-6a4d-4261-8eaa-0df67a903e2e/dns-node-resolver/0.log" Jun 08 19:37:44.952481 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:44.952387 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9hfwf_aef26922-f1bc-4db5-ad6d-89ac2e3adea4/node-ca/0.log" Jun 08 19:37:45.748249 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:45.748213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:37:45.748682 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:37:45.748316 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 19:37:45.748682 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:37:45.748375 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs podName:930e47a3-7e09-414e-b7b2-0d927ad09de8 nodeName:}" failed. No retries permitted until 2026-06-08 19:39:47.748362158 +0000 UTC m=+374.303382613 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs") pod "network-metrics-daemon-6qp7m" (UID: "930e47a3-7e09-414e-b7b2-0d927ad09de8") : secret "metrics-daemon-secret" not found Jun 08 19:37:45.751964 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:45.751939 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z45f2_5dbb6b86-bd1d-4e2d-a79c-cf524764b62a/serve-healthcheck-canary/0.log" Jun 08 19:37:46.152258 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:46.152228 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-nr4pr_74128e62-77db-4559-bb71-8fef731588af/migrator/0.log" Jun 08 19:37:46.228143 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:46.228110 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:46.228305 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:46.228168 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:37:46.228515 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:46.228502 2562 scope.go:117] "RemoveContainer" containerID="a73c3de86186362b54a835c55402bad27e9cd1a70c9aa96ecff706b6b66cd263" Jun 08 19:37:46.228659 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:37:46.228642 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9qhqx_openshift-console-operator(eecda70f-18fd-4432-bc6c-fb293c150cdc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" podUID="eecda70f-18fd-4432-bc6c-fb293c150cdc" Jun 08 19:37:46.365718 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:46.365686 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-nr4pr_74128e62-77db-4559-bb71-8fef731588af/graceful-termination/0.log" Jun 08 19:37:46.554141 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:46.554038 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-lzr88_f9e47502-94b5-4a0f-8159-cc3f8ea5b23a/kube-storage-version-migrator-operator/0.log" Jun 08 19:37:57.915032 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:57.915000 2562 scope.go:117] "RemoveContainer" containerID="a73c3de86186362b54a835c55402bad27e9cd1a70c9aa96ecff706b6b66cd263" Jun 08 19:37:58.782881 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:58.782851 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:37:58.783239 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:58.783223 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/1.log" Jun 08 19:37:58.783289 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:58.783256 2562 generic.go:356] "Generic (PLEG): container finished" podID="eecda70f-18fd-4432-bc6c-fb293c150cdc" containerID="2f19e17f0484f8c284230e8ab2d51df47f7fbd516cbbc9c13f9edfbd941e9bf0" exitCode=255 Jun 08 19:37:58.783327 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:58.783297 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" event={"ID":"eecda70f-18fd-4432-bc6c-fb293c150cdc","Type":"ContainerDied","Data":"2f19e17f0484f8c284230e8ab2d51df47f7fbd516cbbc9c13f9edfbd941e9bf0"} Jun 08 19:37:58.783361 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:58.783342 2562 scope.go:117] "RemoveContainer" containerID="a73c3de86186362b54a835c55402bad27e9cd1a70c9aa96ecff706b6b66cd263" Jun 08 19:37:58.783670 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:58.783638 2562 scope.go:117] "RemoveContainer" containerID="2f19e17f0484f8c284230e8ab2d51df47f7fbd516cbbc9c13f9edfbd941e9bf0" Jun 08 19:37:58.783853 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:37:58.783832 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-9qhqx_openshift-console-operator(eecda70f-18fd-4432-bc6c-fb293c150cdc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" podUID="eecda70f-18fd-4432-bc6c-fb293c150cdc" Jun 08 19:37:59.787382 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:37:59.787353 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:38:06.227701 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:06.227664 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:38:06.228167 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:06.227725 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:38:06.228167 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:06.228020 2562 scope.go:117] "RemoveContainer" containerID="2f19e17f0484f8c284230e8ab2d51df47f7fbd516cbbc9c13f9edfbd941e9bf0" Jun 08 19:38:06.228241 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:06.228176 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-9qhqx_openshift-console-operator(eecda70f-18fd-4432-bc6c-fb293c150cdc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" podUID="eecda70f-18fd-4432-bc6c-fb293c150cdc" Jun 08 19:38:07.631156 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.631117 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mmbkl"] Jun 08 19:38:07.634217 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.634193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.636819 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.636797 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 19:38:07.638168 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.638151 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 19:38:07.638168 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.638166 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r78hc\"" Jun 08 19:38:07.645920 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.645896 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mmbkl"] Jun 08 19:38:07.697260 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.697220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57c0aaca-39a8-4cf5-b230-0c26a71388b3-data-volume\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.697260 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.697261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57c0aaca-39a8-4cf5-b230-0c26a71388b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.697517 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.697345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwssx\" (UniqueName: \"kubernetes.io/projected/57c0aaca-39a8-4cf5-b230-0c26a71388b3-kube-api-access-lwssx\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.697517 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.697469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57c0aaca-39a8-4cf5-b230-0c26a71388b3-crio-socket\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.697517 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.697513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57c0aaca-39a8-4cf5-b230-0c26a71388b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.798225 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.798191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57c0aaca-39a8-4cf5-b230-0c26a71388b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.798474 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.798258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57c0aaca-39a8-4cf5-b230-0c26a71388b3-data-volume\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.798474 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.798280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57c0aaca-39a8-4cf5-b230-0c26a71388b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.798474 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.798321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwssx\" (UniqueName: \"kubernetes.io/projected/57c0aaca-39a8-4cf5-b230-0c26a71388b3-kube-api-access-lwssx\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.798474 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.798362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57c0aaca-39a8-4cf5-b230-0c26a71388b3-crio-socket\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.798474 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.798469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57c0aaca-39a8-4cf5-b230-0c26a71388b3-crio-socket\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.798691 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.798667 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57c0aaca-39a8-4cf5-b230-0c26a71388b3-data-volume\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.798820 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.798802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57c0aaca-39a8-4cf5-b230-0c26a71388b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.800794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.800762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57c0aaca-39a8-4cf5-b230-0c26a71388b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.806806 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.806778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwssx\" (UniqueName: \"kubernetes.io/projected/57c0aaca-39a8-4cf5-b230-0c26a71388b3-kube-api-access-lwssx\") pod \"insights-runtime-extractor-mmbkl\" (UID: \"57c0aaca-39a8-4cf5-b230-0c26a71388b3\") " pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:07.943614 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:07.943529 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mmbkl" Jun 08 19:38:08.062616 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:08.062543 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mmbkl"] Jun 08 19:38:08.065136 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:38:08.065105 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c0aaca_39a8_4cf5_b230_0c26a71388b3.slice/crio-6591b4cee081442e38a86867919a6136ce30230213c31bc181266c8d1e9e0e0b WatchSource:0}: Error finding container 6591b4cee081442e38a86867919a6136ce30230213c31bc181266c8d1e9e0e0b: Status 404 returned error can't find the container with id 6591b4cee081442e38a86867919a6136ce30230213c31bc181266c8d1e9e0e0b Jun 08 19:38:08.820201 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:08.820167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmbkl" event={"ID":"57c0aaca-39a8-4cf5-b230-0c26a71388b3","Type":"ContainerStarted","Data":"cec4c67aad7eea943fee13a8dde7338dd373c026124a19c3ade7b41617706210"} Jun 08 19:38:08.820565 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:08.820223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmbkl" event={"ID":"57c0aaca-39a8-4cf5-b230-0c26a71388b3","Type":"ContainerStarted","Data":"3d046c413add648cf0e827378b194c9fd13cf6157ec8b8675767f9d5576b4592"} Jun 08 19:38:08.820565 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:08.820241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmbkl" event={"ID":"57c0aaca-39a8-4cf5-b230-0c26a71388b3","Type":"ContainerStarted","Data":"6591b4cee081442e38a86867919a6136ce30230213c31bc181266c8d1e9e0e0b"} Jun 08 19:38:10.831738 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:10.831705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmbkl" event={"ID":"57c0aaca-39a8-4cf5-b230-0c26a71388b3","Type":"ContainerStarted","Data":"5b84b636daf3067ec79271900e2c22d6fdd67260cbcf925016c5ddf27beb2718"} Jun 08 19:38:10.851036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:10.850989 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mmbkl" podStartSLOduration=1.6918814979999999 podStartE2EDuration="3.850972713s" totalImagesPullingTime="2.159091215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:38:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:10.849759767 +0000 UTC m=+277.404780234" watchObservedRunningTime="2026-06-08 19:38:10.850972713 +0000 UTC m=+277.405993179" Jun 08 19:38:11.013950 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.013917 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb"] Jun 08 19:38:11.015814 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.015799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" Jun 08 19:38:11.018423 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.018394 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 19:38:11.018575 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.018447 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lddmw\"" Jun 08 19:38:11.021994 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.021971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ecb37c0c-a207-4ccf-8549-76c5216d4755-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fr8wb\" (UID: \"ecb37c0c-a207-4ccf-8549-76c5216d4755\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" Jun 08 19:38:11.025786 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.025764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb"] Jun 08 19:38:11.122868 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.122777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ecb37c0c-a207-4ccf-8549-76c5216d4755-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fr8wb\" (UID: \"ecb37c0c-a207-4ccf-8549-76c5216d4755\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" Jun 08 19:38:11.123014 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:11.122909 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 19:38:11.123014 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:11.122968 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb37c0c-a207-4ccf-8549-76c5216d4755-tls-certificates podName:ecb37c0c-a207-4ccf-8549-76c5216d4755 nodeName:}" failed. No retries permitted until 2026-06-08 19:38:11.622953162 +0000 UTC m=+278.177973606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ecb37c0c-a207-4ccf-8549-76c5216d4755-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-fr8wb" (UID: "ecb37c0c-a207-4ccf-8549-76c5216d4755") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 19:38:11.625940 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.625893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ecb37c0c-a207-4ccf-8549-76c5216d4755-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fr8wb\" (UID: \"ecb37c0c-a207-4ccf-8549-76c5216d4755\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" Jun 08 19:38:11.628335 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.628301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ecb37c0c-a207-4ccf-8549-76c5216d4755-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fr8wb\" (UID: \"ecb37c0c-a207-4ccf-8549-76c5216d4755\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" Jun 08 19:38:11.923980 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:11.923897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" Jun 08 19:38:12.047275 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:12.047223 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb"] Jun 08 19:38:12.049264 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:38:12.049231 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb37c0c_a207_4ccf_8549_76c5216d4755.slice/crio-29f6484a71cea61494daaf8800947a907dce835748030b4f812123df14af0a1d WatchSource:0}: Error finding container 29f6484a71cea61494daaf8800947a907dce835748030b4f812123df14af0a1d: Status 404 returned error can't find the container with id 29f6484a71cea61494daaf8800947a907dce835748030b4f812123df14af0a1d Jun 08 19:38:12.838858 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:12.838822 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" event={"ID":"ecb37c0c-a207-4ccf-8549-76c5216d4755","Type":"ContainerStarted","Data":"29f6484a71cea61494daaf8800947a907dce835748030b4f812123df14af0a1d"} Jun 08 19:38:13.843606 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:13.843574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" event={"ID":"ecb37c0c-a207-4ccf-8549-76c5216d4755","Type":"ContainerStarted","Data":"e3231e58e215dcf05320117733244be804cdb78e206e94e51dd62a26b205ca9c"} Jun 08 19:38:13.844018 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:13.843781 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" Jun 08 19:38:13.848409 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:13.848380 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" Jun 08 19:38:13.859314 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:13.859267 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fr8wb" podStartSLOduration=2.825138394 podStartE2EDuration="3.859252799s" totalImagesPullingTime="1.034114405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:13.859156202 +0000 UTC m=+280.414176678" watchObservedRunningTime="2026-06-08 19:38:13.859252799 +0000 UTC m=+280.414273262" Jun 08 19:38:14.435482 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:14.435413 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8cxxj" podUID="39b49e66-5334-4ffb-926b-dad8d5d0f42a" Jun 08 19:38:14.846697 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:14.846668 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8cxxj" Jun 08 19:38:17.408934 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.408901 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bflb7"] Jun 08 19:38:17.411160 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.411140 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.413851 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.413833 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 19:38:17.413851 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.413840 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 19:38:17.413999 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.413976 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 19:38:17.414503 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.414486 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 19:38:17.415090 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.415065 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 19:38:17.415171 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.415135 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w8xp7\"" Jun 08 19:38:17.415231 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.415175 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 19:38:17.469359 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.469314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-wtmp\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.469587 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.469366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.469587 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.469421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-tls\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.469587 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.469473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-sys\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.469587 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.469523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-textfile\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.469587 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.469544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgxv\" (UniqueName: \"kubernetes.io/projected/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-kube-api-access-mfgxv\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.469774 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.469593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-metrics-client-ca\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.469774 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.469633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.469774 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.469653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-root\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.569985 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.569944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-root\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.569985 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.569994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-wtmp\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-tls\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570057 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-root\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-sys\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570112 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-sys\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-wtmp\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-textfile\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgxv\" (UniqueName: \"kubernetes.io/projected/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-kube-api-access-mfgxv\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:17.570187 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 19:38:17.570233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-metrics-client-ca\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570685 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:17.570245 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-tls podName:b0f6faf1-11c3-4faf-82f2-7bebf34654e7 nodeName:}" failed. No retries permitted until 2026-06-08 19:38:18.070227911 +0000 UTC m=+284.625248376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-tls") pod "node-exporter-bflb7" (UID: "b0f6faf1-11c3-4faf-82f2-7bebf34654e7") : secret "node-exporter-tls" not found Jun 08 19:38:17.570685 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570685 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570488 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-textfile\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570809 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570774 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-metrics-client-ca\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.570843 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.570816 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.572387 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.572364 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.580837 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.580812 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgxv\" (UniqueName: \"kubernetes.io/projected/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-kube-api-access-mfgxv\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:17.772031 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.771941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:38:17.774326 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.774293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39b49e66-5334-4ffb-926b-dad8d5d0f42a-metrics-tls\") pod \"dns-default-8cxxj\" (UID: \"39b49e66-5334-4ffb-926b-dad8d5d0f42a\") " pod="openshift-dns/dns-default-8cxxj" Jun 08 19:38:17.849693 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.849663 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dhlvj\"" Jun 08 19:38:17.857707 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:17.857681 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8cxxj" Jun 08 19:38:18.000236 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.000212 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8cxxj"] Jun 08 19:38:18.002660 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:38:18.002635 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b49e66_5334_4ffb_926b_dad8d5d0f42a.slice/crio-67b4ff0078efac2083540455adc0f52a2bd399d9445b970c3b6a9498c1a3f715 WatchSource:0}: Error finding container 67b4ff0078efac2083540455adc0f52a2bd399d9445b970c3b6a9498c1a3f715: Status 404 returned error can't find the container with id 67b4ff0078efac2083540455adc0f52a2bd399d9445b970c3b6a9498c1a3f715 Jun 08 19:38:18.074804 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.074777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-tls\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:18.077028 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.076998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0f6faf1-11c3-4faf-82f2-7bebf34654e7-node-exporter-tls\") pod \"node-exporter-bflb7\" (UID: \"b0f6faf1-11c3-4faf-82f2-7bebf34654e7\") " pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:18.320034 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.319995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bflb7" Jun 08 19:38:18.329821 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:38:18.329789 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f6faf1_11c3_4faf_82f2_7bebf34654e7.slice/crio-a72f27ca15bc1befdea950abe14461015f617a3aff6eb47970d1e233427303f5 WatchSource:0}: Error finding container a72f27ca15bc1befdea950abe14461015f617a3aff6eb47970d1e233427303f5: Status 404 returned error can't find the container with id a72f27ca15bc1befdea950abe14461015f617a3aff6eb47970d1e233427303f5 Jun 08 19:38:18.457963 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.457927 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:38:18.461370 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.461346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.463972 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.463944 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ksgzf\"" Jun 08 19:38:18.464105 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.463948 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 19:38:18.464173 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.464151 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 19:38:18.464225 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.464175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 19:38:18.464466 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.464377 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 19:38:18.464466 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.464424 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 19:38:18.464466 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.464450 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 19:38:18.464699 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.464680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 19:38:18.464898 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.464878 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 19:38:18.465258 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.465235 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 19:38:18.475826 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.475800 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:38:18.477670 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.477646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.477840 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.477824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.477941 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.477923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478021 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.477995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478078 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.478031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478078 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.478058 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478173 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.478134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-volume\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478213 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.478189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478262 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.478210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztd8f\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-kube-api-access-ztd8f\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478262 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.478230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-out\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478401 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.478385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-web-config\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478474 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.478413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.478474 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.478458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579450 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579450 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579450 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579712 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-volume\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579712 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579712 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztd8f\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-kube-api-access-ztd8f\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579712 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-out\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579712 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-web-config\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579712 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579712 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579712 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579680 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.579712 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579712 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.580135 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.579751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.580202 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.580176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.581332 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.580730 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.581332 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:18.580862 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-trusted-ca-bundle podName:8a8622f4-fe5a-44e8-9e22-bebdb943eb37 nodeName:}" failed. No retries permitted until 2026-06-08 19:38:19.080841324 +0000 UTC m=+285.635861768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37") : configmap references non-existent config key: ca-bundle.crt Jun 08 19:38:18.583044 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.583014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.583151 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.583117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-web-config\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.584104 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.584060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.584991 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.584810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.584991 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.584933 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-volume\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.585130 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.585007 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.585130 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.585075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.585861 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.585839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.586099 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.586065 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-out\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.587930 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.587909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztd8f\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-kube-api-access-ztd8f\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:18.860333 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.860225 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8cxxj" event={"ID":"39b49e66-5334-4ffb-926b-dad8d5d0f42a","Type":"ContainerStarted","Data":"67b4ff0078efac2083540455adc0f52a2bd399d9445b970c3b6a9498c1a3f715"} Jun 08 19:38:18.861544 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.861517 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bflb7" event={"ID":"b0f6faf1-11c3-4faf-82f2-7bebf34654e7","Type":"ContainerStarted","Data":"a72f27ca15bc1befdea950abe14461015f617a3aff6eb47970d1e233427303f5"} Jun 08 19:38:18.915092 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:18.915065 2562 scope.go:117] "RemoveContainer" containerID="2f19e17f0484f8c284230e8ab2d51df47f7fbd516cbbc9c13f9edfbd941e9bf0" Jun 08 19:38:19.085242 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.085196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:19.086134 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.086100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:19.372998 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.372961 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:38:19.862649 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.862611 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:38:19.868201 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:38:19.868087 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8622f4_fe5a_44e8_9e22_bebdb943eb37.slice/crio-9e948fc72e7d38dae9120d8f5199e99d3de439bbf87ec5c7bfda793ce74b90a5 WatchSource:0}: Error finding container 9e948fc72e7d38dae9120d8f5199e99d3de439bbf87ec5c7bfda793ce74b90a5: Status 404 returned error can't find the container with id 9e948fc72e7d38dae9120d8f5199e99d3de439bbf87ec5c7bfda793ce74b90a5 Jun 08 19:38:19.872919 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.872874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8cxxj" event={"ID":"39b49e66-5334-4ffb-926b-dad8d5d0f42a","Type":"ContainerStarted","Data":"7cba0a506580063af692293f058b6e6b4061f6da4b85957e821e56db80d7e7b9"} Jun 08 19:38:19.875882 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.875861 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:38:19.876066 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.875980 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" event={"ID":"eecda70f-18fd-4432-bc6c-fb293c150cdc","Type":"ContainerStarted","Data":"baf1e1bb4792bb53bea0886f72febe2184443922a9e91ee2d4dc6367cdc5e645"} Jun 08 19:38:19.876506 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.876485 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:38:19.880122 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.879501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bflb7" event={"ID":"b0f6faf1-11c3-4faf-82f2-7bebf34654e7","Type":"ContainerStarted","Data":"b5800c992e4d1fbd265d541d83fef8e3aa6966dde036e717677d89b1871ef6f0"} Jun 08 19:38:19.895626 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:19.894759 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" podStartSLOduration=41.488111165 podStartE2EDuration="44.894738793s" totalImagesPullingTime="3.406627628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:19.894369934 +0000 UTC m=+286.449390402" watchObservedRunningTime="2026-06-08 19:38:19.894738793 +0000 UTC m=+286.449759263" Jun 08 19:38:20.010562 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:20.010527 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-9qhqx" Jun 08 19:38:20.885069 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:20.885040 2562 generic.go:356] "Generic (PLEG): container finished" podID="b0f6faf1-11c3-4faf-82f2-7bebf34654e7" containerID="b5800c992e4d1fbd265d541d83fef8e3aa6966dde036e717677d89b1871ef6f0" exitCode=0 Jun 08 19:38:20.885504 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:20.885131 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bflb7" event={"ID":"b0f6faf1-11c3-4faf-82f2-7bebf34654e7","Type":"ContainerDied","Data":"b5800c992e4d1fbd265d541d83fef8e3aa6966dde036e717677d89b1871ef6f0"} Jun 08 19:38:20.886946 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:20.886921 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8cxxj" event={"ID":"39b49e66-5334-4ffb-926b-dad8d5d0f42a","Type":"ContainerStarted","Data":"55771d2349e683eaf3089fe62c7058c9987fbba3b833db47699f81e658cd80ed"} Jun 08 19:38:20.887075 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:20.886976 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8cxxj" Jun 08 19:38:20.888488 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:20.888466 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerID="b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887" exitCode=0 Jun 08 19:38:20.888575 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:20.888522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerDied","Data":"b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887"} Jun 08 19:38:20.888619 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:20.888599 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerStarted","Data":"9e948fc72e7d38dae9120d8f5199e99d3de439bbf87ec5c7bfda793ce74b90a5"} Jun 08 19:38:20.962411 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:20.962366 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8cxxj" podStartSLOduration=252.253459158 podStartE2EDuration="4m13.962345696s" totalImagesPullingTime="1.708886538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:20.961642619 +0000 UTC m=+287.516663086" watchObservedRunningTime="2026-06-08 19:38:20.962345696 +0000 UTC m=+287.517366167" Jun 08 19:38:21.894321 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:21.894279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bflb7" event={"ID":"b0f6faf1-11c3-4faf-82f2-7bebf34654e7","Type":"ContainerStarted","Data":"565cd3c130519baa3a4ce92d3484baa27ab0f9bec7a29d9836ec547af643891e"} Jun 08 19:38:21.894793 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:21.894337 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bflb7" event={"ID":"b0f6faf1-11c3-4faf-82f2-7bebf34654e7","Type":"ContainerStarted","Data":"fd6bbff770357e3f79730ebc0fc66d45c8408748e7268a758881d908094a3d70"} Jun 08 19:38:21.914707 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:21.914656 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bflb7" podStartSLOduration=3.448169635 podStartE2EDuration="4.914641696s" totalImagesPullingTime="1.375250397s" totalInitContainerRuntime="91.221664ms" isStatefulPod=true podCreationTimestamp="2026-06-08 19:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:21.914521772 +0000 UTC m=+288.469542238" watchObservedRunningTime="2026-06-08 19:38:21.914641696 +0000 UTC m=+288.469662162" Jun 08 19:38:22.210193 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.210110 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6"] Jun 08 19:38:22.212884 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.212866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:22.215504 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.215483 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mrsrr\"" Jun 08 19:38:22.215600 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.215485 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 19:38:22.223015 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.222992 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6"] Jun 08 19:38:22.316650 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.316618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df72b90b-fff9-471a-a0b7-92539cfb3a68-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-lcnj6\" (UID: \"df72b90b-fff9-471a-a0b7-92539cfb3a68\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:22.316819 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.316674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drnqv\" (UniqueName: \"kubernetes.io/projected/df72b90b-fff9-471a-a0b7-92539cfb3a68-kube-api-access-drnqv\") pod \"monitoring-plugin-76b68cc874-lcnj6\" (UID: \"df72b90b-fff9-471a-a0b7-92539cfb3a68\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:22.418867 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.418120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df72b90b-fff9-471a-a0b7-92539cfb3a68-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-lcnj6\" (UID: \"df72b90b-fff9-471a-a0b7-92539cfb3a68\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:22.418867 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.418185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drnqv\" (UniqueName: \"kubernetes.io/projected/df72b90b-fff9-471a-a0b7-92539cfb3a68-kube-api-access-drnqv\") pod \"monitoring-plugin-76b68cc874-lcnj6\" (UID: \"df72b90b-fff9-471a-a0b7-92539cfb3a68\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:22.418867 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:22.418249 2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 08 19:38:22.418867 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:22.418314 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df72b90b-fff9-471a-a0b7-92539cfb3a68-monitoring-plugin-cert podName:df72b90b-fff9-471a-a0b7-92539cfb3a68 nodeName:}" failed. No retries permitted until 2026-06-08 19:38:22.918298071 +0000 UTC m=+289.473318532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/df72b90b-fff9-471a-a0b7-92539cfb3a68-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-lcnj6" (UID: "df72b90b-fff9-471a-a0b7-92539cfb3a68") : secret "monitoring-plugin-cert" not found Jun 08 19:38:22.428303 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.428279 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drnqv\" (UniqueName: \"kubernetes.io/projected/df72b90b-fff9-471a-a0b7-92539cfb3a68-kube-api-access-drnqv\") pod \"monitoring-plugin-76b68cc874-lcnj6\" (UID: \"df72b90b-fff9-471a-a0b7-92539cfb3a68\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:22.901476 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.901446 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerStarted","Data":"da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192"} Jun 08 19:38:22.901822 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.901512 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerStarted","Data":"54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058"} Jun 08 19:38:22.901822 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.901538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerStarted","Data":"ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7"} Jun 08 19:38:22.901822 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.901566 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerStarted","Data":"4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303"} Jun 08 19:38:22.901822 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.901590 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerStarted","Data":"b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca"} Jun 08 19:38:22.922319 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.922288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df72b90b-fff9-471a-a0b7-92539cfb3a68-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-lcnj6\" (UID: \"df72b90b-fff9-471a-a0b7-92539cfb3a68\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:22.924648 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:22.924629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df72b90b-fff9-471a-a0b7-92539cfb3a68-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-lcnj6\" (UID: \"df72b90b-fff9-471a-a0b7-92539cfb3a68\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:23.123733 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.123695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:23.258100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.258075 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6"] Jun 08 19:38:23.297354 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:38:23.297325 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf72b90b_fff9_471a_a0b7_92539cfb3a68.slice/crio-40ff5f65f2747d83a7ff942ef5d69990572acb6515babd61236cd056d0c47120 WatchSource:0}: Error finding container 40ff5f65f2747d83a7ff942ef5d69990572acb6515babd61236cd056d0c47120: Status 404 returned error can't find the container with id 40ff5f65f2747d83a7ff942ef5d69990572acb6515babd61236cd056d0c47120 Jun 08 19:38:23.639644 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.639610 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:38:23.642330 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.642308 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.644891 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.644861 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 19:38:23.645001 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.644966 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 19:38:23.645065 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.645026 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 19:38:23.645121 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.645105 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 19:38:23.645269 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.645251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w7hg9\"" Jun 08 19:38:23.645362 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.645342 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 19:38:23.645406 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.645381 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-851n0ro0lbsjl\"" Jun 08 19:38:23.645495 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.645481 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 19:38:23.646055 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.646040 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 19:38:23.646235 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.646219 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 19:38:23.646304 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.646247 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 19:38:23.646304 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.646265 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 19:38:23.646540 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.646505 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 19:38:23.646540 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.646522 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 19:38:23.646540 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.646530 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 19:38:23.646725 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.646677 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 19:38:23.649145 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.649127 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 19:38:23.658404 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.658377 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:38:23.728820 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.728793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.728820 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.728823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g7r8\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-kube-api-access-4g7r8\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.728995 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.728866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.728995 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.728883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.728995 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.728903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.728995 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.728920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.728995 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.728934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.728995 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.728970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.728999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-web-config\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729076 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729185 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729177 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config-out\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729535 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.729535 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.729270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830298 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830298 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-web-config\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830564 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830564 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830564 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830564 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830564 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830564 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830564 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830564 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config-out\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830670 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g7r8\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-kube-api-access-4g7r8\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.830939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.830912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.831487 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.831245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.832794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.831778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.832794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.832418 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.833655 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.833628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.834007 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.833976 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.834165 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.834140 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.834577 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.834548 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.834961 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.834938 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.835603 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.835416 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-web-config\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.835603 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.835418 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.835912 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.835868 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.836107 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.836080 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config-out\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.836293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.836245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.836855 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.836392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.836855 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.836810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.837128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.837105 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.837460 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.837406 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.837725 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.837705 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.840795 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.840773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g7r8\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-kube-api-access-4g7r8\") pod \"prometheus-k8s-0\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:23.909872 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.909834 2562 generic.go:356] "Generic (PLEG): container finished" podID="088e5a69-f868-4229-8599-7f75dbd5e66c" containerID="6484c963276fb84729e0855c680c7bd4455097e608429cee9e39ab0444bd0d6e" exitCode=1 Jun 08 19:38:23.910332 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.909906 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" event={"ID":"088e5a69-f868-4229-8599-7f75dbd5e66c","Type":"ContainerDied","Data":"6484c963276fb84729e0855c680c7bd4455097e608429cee9e39ab0444bd0d6e"} Jun 08 19:38:23.910332 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.909967 2562 scope.go:117] "RemoveContainer" containerID="ce4332dfc73c10b53c390fb36be092308ed857a6b2a692b04d477f86bc178428" Jun 08 19:38:23.910332 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.910316 2562 scope.go:117] "RemoveContainer" containerID="6484c963276fb84729e0855c680c7bd4455097e608429cee9e39ab0444bd0d6e" Jun 08 19:38:23.910561 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:23.910531 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-85fcfdc7dd-rhs9p_open-cluster-management-agent-addon(088e5a69-f868-4229-8599-7f75dbd5e66c)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" podUID="088e5a69-f868-4229-8599-7f75dbd5e66c" Jun 08 19:38:23.917147 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.917120 2562 generic.go:356] "Generic (PLEG): container finished" podID="c89487df-1d1e-4d9f-a6b7-698e3d8f48c5" containerID="b93f4f59ddd0da724551896f22f4181a580b727085a632f88ad6de91e7078458" exitCode=255 Jun 08 19:38:23.925068 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.925028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerStarted","Data":"fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec"} Jun 08 19:38:23.925187 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.925114 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" event={"ID":"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5","Type":"ContainerDied","Data":"b93f4f59ddd0da724551896f22f4181a580b727085a632f88ad6de91e7078458"} Jun 08 19:38:23.925187 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.925139 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" event={"ID":"df72b90b-fff9-471a-a0b7-92539cfb3a68","Type":"ContainerStarted","Data":"40ff5f65f2747d83a7ff942ef5d69990572acb6515babd61236cd056d0c47120"} Jun 08 19:38:23.925187 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.925168 2562 scope.go:117] "RemoveContainer" containerID="e106628e5b133359654c9524e84e2773d6a5ba546e3addf092c4f9ab5a090fa7" Jun 08 19:38:23.935959 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.935939 2562 scope.go:117] "RemoveContainer" containerID="b93f4f59ddd0da724551896f22f4181a580b727085a632f88ad6de91e7078458" Jun 08 19:38:23.936139 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:23.936120 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-89446bf44-r7kln_open-cluster-management-agent-addon(c89487df-1d1e-4d9f-a6b7-698e3d8f48c5)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" podUID="c89487df-1d1e-4d9f-a6b7-698e3d8f48c5" Jun 08 19:38:23.954583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:23.954526 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.903551079 podStartE2EDuration="5.95450738s" totalImagesPullingTime="3.034917323s" totalInitContainerRuntime="16.038978ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:23.952215153 +0000 UTC m=+290.507235632" watchObservedRunningTime="2026-06-08 19:38:23.95450738 +0000 UTC m=+290.509527847" Jun 08 19:38:24.016609 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.016576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:24.169801 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.169776 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:38:24.171924 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:38:24.171897 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6e81d9_3d2e_4e58_bd8a_9d7dc540e198.slice/crio-2568dd07b7f8a4a47773c81e09d3481d7147739a577bdb6009b646eadad9df17 WatchSource:0}: Error finding container 2568dd07b7f8a4a47773c81e09d3481d7147739a577bdb6009b646eadad9df17: Status 404 returned error can't find the container with id 2568dd07b7f8a4a47773c81e09d3481d7147739a577bdb6009b646eadad9df17 Jun 08 19:38:24.474169 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.474074 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:38:24.924014 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.923984 2562 scope.go:117] "RemoveContainer" containerID="6484c963276fb84729e0855c680c7bd4455097e608429cee9e39ab0444bd0d6e" Jun 08 19:38:24.924465 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:24.924152 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-85fcfdc7dd-rhs9p_open-cluster-management-agent-addon(088e5a69-f868-4229-8599-7f75dbd5e66c)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" podUID="088e5a69-f868-4229-8599-7f75dbd5e66c" Jun 08 19:38:24.926397 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.926375 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" event={"ID":"df72b90b-fff9-471a-a0b7-92539cfb3a68","Type":"ContainerStarted","Data":"9fb9fc03eedecc507f9402762472f388f846dcdafef4826db3afc20c96171f82"} Jun 08 19:38:24.926515 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.926454 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:24.928038 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.928018 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerID="9f91bbb3e744ae580aa425bc23e174a3aa1da2e7bbaad579f71b9e4f1ce7f720" exitCode=0 Jun 08 19:38:24.928109 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.928051 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerDied","Data":"9f91bbb3e744ae580aa425bc23e174a3aa1da2e7bbaad579f71b9e4f1ce7f720"} Jun 08 19:38:24.928182 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.928124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerStarted","Data":"2568dd07b7f8a4a47773c81e09d3481d7147739a577bdb6009b646eadad9df17"} Jun 08 19:38:24.931863 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.931838 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" Jun 08 19:38:24.955183 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:24.955131 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-lcnj6" podStartSLOduration=1.5731499310000001 podStartE2EDuration="2.95511207s" totalImagesPullingTime="1.381962139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:24.954737376 +0000 UTC m=+291.509757842" watchObservedRunningTime="2026-06-08 19:38:24.95511207 +0000 UTC m=+291.510132585" Jun 08 19:38:27.532666 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:27.532624 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" Jun 08 19:38:27.533137 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:27.533057 2562 scope.go:117] "RemoveContainer" containerID="b93f4f59ddd0da724551896f22f4181a580b727085a632f88ad6de91e7078458" Jun 08 19:38:27.533267 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:27.533239 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-89446bf44-r7kln_open-cluster-management-agent-addon(c89487df-1d1e-4d9f-a6b7-698e3d8f48c5)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" podUID="c89487df-1d1e-4d9f-a6b7-698e3d8f48c5" Jun 08 19:38:27.539714 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:27.539689 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:38:27.540094 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:27.540077 2562 scope.go:117] "RemoveContainer" containerID="6484c963276fb84729e0855c680c7bd4455097e608429cee9e39ab0444bd0d6e" Jun 08 19:38:27.540285 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:27.540261 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-85fcfdc7dd-rhs9p_open-cluster-management-agent-addon(088e5a69-f868-4229-8599-7f75dbd5e66c)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" podUID="088e5a69-f868-4229-8599-7f75dbd5e66c" Jun 08 19:38:27.916292 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:38:27.916259 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6qp7m" podUID="930e47a3-7e09-414e-b7b2-0d927ad09de8" Jun 08 19:38:27.943958 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:27.943922 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerStarted","Data":"8320c8fe397ede11b73fb6353c1f43b861573b69ee30a2e1b8b217161d453b8b"} Jun 08 19:38:27.944084 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:27.944012 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerStarted","Data":"d7f919546cc42282334babec1ec6b03073f3619cdd57b7243b7a4cc223e1f897"} Jun 08 19:38:29.955662 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:29.955637 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerStarted","Data":"0fc2b9278d60fe79acf4148a1250768951513ef6ab54c41423db4306fc3ddc17"} Jun 08 19:38:30.896498 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:30.896463 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8cxxj" Jun 08 19:38:30.962929 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:30.962883 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerStarted","Data":"8f9b63780f502347b2d9ab41e8dea47491d75c8239c3f6d259f78248d5eae91f"} Jun 08 19:38:30.963389 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:30.962965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerStarted","Data":"b3c12503580f13d2df4503a09056b1ccdf0780f11c2f7ad378c85c4f7697b592"} Jun 08 19:38:30.963389 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:30.963004 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerStarted","Data":"f09922f149500bedc42f4e94021de0f92837a6a7757f3b8b032dadf22c222475"} Jun 08 19:38:30.998273 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:30.998205 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.215344361 podStartE2EDuration="7.998184689s" totalImagesPullingTime="4.764683965s" totalInitContainerRuntime="18.156363ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:38:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:38:30.996576081 +0000 UTC m=+297.551596568" watchObservedRunningTime="2026-06-08 19:38:30.998184689 +0000 UTC m=+297.553205157" Jun 08 19:38:33.865390 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:33.865359 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:38:33.866376 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:33.866351 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:38:33.872112 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:33.872083 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:38:33.877079 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:33.877051 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:38:33.885962 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:33.885938 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 19:38:34.017415 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:34.017266 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:38:38.920454 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:38.920409 2562 scope.go:117] "RemoveContainer" containerID="b93f4f59ddd0da724551896f22f4181a580b727085a632f88ad6de91e7078458" Jun 08 19:38:38.992610 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:38.992565 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-89446bf44-r7kln" event={"ID":"c89487df-1d1e-4d9f-a6b7-698e3d8f48c5","Type":"ContainerStarted","Data":"394e32032cab642102254cb7c21524de718c7836274bf12c3df9bdb6c935db23"} Jun 08 19:38:39.915454 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:39.915399 2562 scope.go:117] "RemoveContainer" containerID="6484c963276fb84729e0855c680c7bd4455097e608429cee9e39ab0444bd0d6e" Jun 08 19:38:39.998685 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:39.998654 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" event={"ID":"088e5a69-f868-4229-8599-7f75dbd5e66c","Type":"ContainerStarted","Data":"3415d4337728e7a9c0b6b368e821ad0d70c516b6729f5ce2534876336ad7e292"} Jun 08 19:38:39.999126 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:39.999034 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:38:40.000077 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:40.000046 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" podUID="088e5a69-f868-4229-8599-7f75dbd5e66c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused" Jun 08 19:38:41.003846 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:41.003816 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85fcfdc7dd-rhs9p" Jun 08 19:38:41.915054 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:41.915013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:38:51.042596 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:51.042561 2562 generic.go:356] "Generic (PLEG): container finished" podID="ded5d224-43e6-4e02-a2b2-85ab7ba7149b" containerID="1ec6ca062028aa62887800881ee32a6dad6b932836ba8cb4c704088b21b72d9c" exitCode=0 Jun 08 19:38:51.042969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:51.042635 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" event={"ID":"ded5d224-43e6-4e02-a2b2-85ab7ba7149b","Type":"ContainerDied","Data":"1ec6ca062028aa62887800881ee32a6dad6b932836ba8cb4c704088b21b72d9c"} Jun 08 19:38:51.043011 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:51.042968 2562 scope.go:117] "RemoveContainer" containerID="1ec6ca062028aa62887800881ee32a6dad6b932836ba8cb4c704088b21b72d9c" Jun 08 19:38:52.048358 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:38:52.048327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-znflw" event={"ID":"ded5d224-43e6-4e02-a2b2-85ab7ba7149b","Type":"ContainerStarted","Data":"f9eb192b87d1ac421b139d4ecc2b1b03874d90357bdec4ec62c9e3ad771925fc"} Jun 08 19:39:01.081575 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:01.081542 2562 generic.go:356] "Generic (PLEG): container finished" podID="f9e47502-94b5-4a0f-8159-cc3f8ea5b23a" containerID="8f83487927c8ebc4031d6712bec4bff6e22927a4999147748f99d2285fc3ac20" exitCode=0 Jun 08 19:39:01.081928 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:01.081581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" event={"ID":"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a","Type":"ContainerDied","Data":"8f83487927c8ebc4031d6712bec4bff6e22927a4999147748f99d2285fc3ac20"} Jun 08 19:39:01.081928 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:01.081862 2562 scope.go:117] "RemoveContainer" containerID="8f83487927c8ebc4031d6712bec4bff6e22927a4999147748f99d2285fc3ac20" Jun 08 19:39:02.087015 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:02.086979 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lzr88" event={"ID":"f9e47502-94b5-4a0f-8159-cc3f8ea5b23a","Type":"ContainerStarted","Data":"c6be2b25cde566ea0df3ed4a317063d98f5b1e8140da7948236ebde0f0bdbe0f"} Jun 08 19:39:11.121733 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:11.121694 2562 generic.go:356] "Generic (PLEG): container finished" podID="3a49d924-67c1-4f3c-bfd5-d296abb7196d" containerID="eacb1276bbd99d73363c817b9366a9be09bcef76355d5e01de695433dd6c6391" exitCode=0 Jun 08 19:39:11.122169 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:11.121768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fbczw" event={"ID":"3a49d924-67c1-4f3c-bfd5-d296abb7196d","Type":"ContainerDied","Data":"eacb1276bbd99d73363c817b9366a9be09bcef76355d5e01de695433dd6c6391"} Jun 08 19:39:11.122169 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:11.122104 2562 scope.go:117] "RemoveContainer" containerID="eacb1276bbd99d73363c817b9366a9be09bcef76355d5e01de695433dd6c6391" Jun 08 19:39:12.126741 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:12.126708 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-fbczw" event={"ID":"3a49d924-67c1-4f3c-bfd5-d296abb7196d","Type":"ContainerStarted","Data":"4732c2ae920888a55b235eb7ab88453311e20af6671765bdab1ea0a2d9a848e8"} Jun 08 19:39:24.017699 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:24.017596 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:24.041617 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:24.041573 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:24.199238 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:24.199197 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:37.728507 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:37.728473 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:39:37.728899 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:37.728770 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="alertmanager" containerID="cri-o://b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca" gracePeriod=120 Jun 08 19:39:37.728899 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:37.728856 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy-web" containerID="cri-o://ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7" gracePeriod=120 Jun 08 19:39:37.728899 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:37.728852 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy-metric" containerID="cri-o://da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192" gracePeriod=120 Jun 08 19:39:37.729071 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:37.728891 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="config-reloader" containerID="cri-o://4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303" gracePeriod=120 Jun 08 19:39:37.729071 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:37.728907 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy" containerID="cri-o://54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058" gracePeriod=120 Jun 08 19:39:37.729071 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:37.728935 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="prom-label-proxy" containerID="cri-o://fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec" gracePeriod=120 Jun 08 19:39:38.238774 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:38.238738 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerID="fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec" exitCode=0 Jun 08 19:39:38.238774 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:38.238764 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerID="54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058" exitCode=0 Jun 08 19:39:38.238774 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:38.238770 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerID="4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303" exitCode=0 Jun 08 19:39:38.238774 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:38.238775 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerID="b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca" exitCode=0 Jun 08 19:39:38.239027 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:38.238793 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerDied","Data":"fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec"} Jun 08 19:39:38.239027 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:38.238844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerDied","Data":"54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058"} Jun 08 19:39:38.239027 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:38.238869 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerDied","Data":"4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303"} Jun 08 19:39:38.239027 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:38.238892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerDied","Data":"b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca"} Jun 08 19:39:38.968135 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:38.968110 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.088139 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088111 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-tls-assets\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088153 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088190 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-out\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088226 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-metrics-client-ca\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088253 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088293 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-cluster-tls-config\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088327 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-main-db\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088352 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztd8f\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-kube-api-access-ztd8f\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088375 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-web-config\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088405 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-main-tls\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088461 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-trusted-ca-bundle\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088509 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-web\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088581 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-volume\") pod \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\" (UID: \"8a8622f4-fe5a-44e8-9e22-bebdb943eb37\") " Jun 08 19:39:39.088957 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088657 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:39.088957 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088693 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:39:39.088957 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088887 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-metrics-client-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.088957 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.088907 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-main-db\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.089487 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.089416 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:39.091412 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.091367 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:39.091547 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.091453 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-volume" (OuterVolumeSpecName: "config-volume") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:39.091620 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.091593 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-kube-api-access-ztd8f" (OuterVolumeSpecName: "kube-api-access-ztd8f") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "kube-api-access-ztd8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:39:39.091724 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.091695 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:39.091844 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.091827 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:39:39.091950 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.091934 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-out" (OuterVolumeSpecName: "config-out") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:39:39.092384 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.092351 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:39.092962 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.092938 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:39.095830 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.095804 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:39.103249 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.103218 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-web-config" (OuterVolumeSpecName: "web-config") pod "8a8622f4-fe5a-44e8-9e22-bebdb943eb37" (UID: "8a8622f4-fe5a-44e8-9e22-bebdb943eb37"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:39.189819 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189788 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-cluster-tls-config\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.189819 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189818 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztd8f\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-kube-api-access-ztd8f\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.190036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189830 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-web-config\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.190036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189843 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-main-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.190036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189859 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.190036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189872 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.190036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189883 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-volume\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.190036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189894 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-tls-assets\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.190036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189906 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.190036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189917 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-config-out\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.190036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.189929 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a8622f4-fe5a-44e8-9e22-bebdb943eb37-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:39.245682 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.245653 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerID="da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192" exitCode=0 Jun 08 19:39:39.245682 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.245676 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerID="ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7" exitCode=0 Jun 08 19:39:39.245888 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.245719 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerDied","Data":"da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192"} Jun 08 19:39:39.245888 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.245725 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.245888 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.245773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerDied","Data":"ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7"} Jun 08 19:39:39.245888 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.245800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a8622f4-fe5a-44e8-9e22-bebdb943eb37","Type":"ContainerDied","Data":"9e948fc72e7d38dae9120d8f5199e99d3de439bbf87ec5c7bfda793ce74b90a5"} Jun 08 19:39:39.245888 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.245829 2562 scope.go:117] "RemoveContainer" containerID="fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec" Jun 08 19:39:39.255822 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.255746 2562 scope.go:117] "RemoveContainer" containerID="da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192" Jun 08 19:39:39.263240 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.263221 2562 scope.go:117] "RemoveContainer" containerID="54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058" Jun 08 19:39:39.270119 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.270097 2562 scope.go:117] "RemoveContainer" containerID="ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7" Jun 08 19:39:39.275013 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.274990 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:39:39.278818 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.278800 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:39:39.278904 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.278885 2562 scope.go:117] "RemoveContainer" containerID="4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303" Jun 08 19:39:39.286106 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.286084 2562 scope.go:117] "RemoveContainer" containerID="b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca" Jun 08 19:39:39.292993 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.292970 2562 scope.go:117] "RemoveContainer" containerID="b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887" Jun 08 19:39:39.300242 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.300223 2562 scope.go:117] "RemoveContainer" containerID="fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec" Jun 08 19:39:39.300558 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:39:39.300538 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec\": container with ID starting with fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec not found: ID does not exist" containerID="fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec" Jun 08 19:39:39.300618 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.300567 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec"} err="failed to get container status \"fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec\": rpc error: code = NotFound desc = could not find container \"fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec\": container with ID starting with fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec not found: ID does not exist" Jun 08 19:39:39.300618 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.300601 2562 scope.go:117] "RemoveContainer" containerID="da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192" Jun 08 19:39:39.300852 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:39:39.300834 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192\": container with ID starting with da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192 not found: ID does not exist" containerID="da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192" Jun 08 19:39:39.300894 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.300858 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192"} err="failed to get container status \"da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192\": rpc error: code = NotFound desc = could not find container \"da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192\": container with ID starting with da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192 not found: ID does not exist" Jun 08 19:39:39.300894 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.300875 2562 scope.go:117] "RemoveContainer" containerID="54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058" Jun 08 19:39:39.301116 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:39:39.301100 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058\": container with ID starting with 54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058 not found: ID does not exist" containerID="54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058" Jun 08 19:39:39.301156 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.301121 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058"} err="failed to get container status \"54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058\": rpc error: code = NotFound desc = could not find container \"54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058\": container with ID starting with 54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058 not found: ID does not exist" Jun 08 19:39:39.301156 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.301136 2562 scope.go:117] "RemoveContainer" containerID="ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7" Jun 08 19:39:39.301381 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:39:39.301364 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7\": container with ID starting with ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7 not found: ID does not exist" containerID="ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7" Jun 08 19:39:39.301421 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.301387 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7"} err="failed to get container status \"ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7\": rpc error: code = NotFound desc = could not find container \"ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7\": container with ID starting with ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7 not found: ID does not exist" Jun 08 19:39:39.301421 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.301403 2562 scope.go:117] "RemoveContainer" containerID="4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303" Jun 08 19:39:39.301660 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:39:39.301641 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303\": container with ID starting with 4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303 not found: ID does not exist" containerID="4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303" Jun 08 19:39:39.301741 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.301663 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303"} err="failed to get container status \"4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303\": rpc error: code = NotFound desc = could not find container \"4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303\": container with ID starting with 4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303 not found: ID does not exist" Jun 08 19:39:39.301741 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.301676 2562 scope.go:117] "RemoveContainer" containerID="b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca" Jun 08 19:39:39.301866 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:39:39.301853 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca\": container with ID starting with b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca not found: ID does not exist" containerID="b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca" Jun 08 19:39:39.301903 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.301869 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca"} err="failed to get container status \"b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca\": rpc error: code = NotFound desc = could not find container \"b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca\": container with ID starting with b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca not found: ID does not exist" Jun 08 19:39:39.301903 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.301883 2562 scope.go:117] "RemoveContainer" containerID="b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887" Jun 08 19:39:39.302094 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:39:39.302078 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887\": container with ID starting with b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887 not found: ID does not exist" containerID="b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887" Jun 08 19:39:39.302133 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.302099 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887"} err="failed to get container status \"b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887\": rpc error: code = NotFound desc = could not find container \"b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887\": container with ID starting with b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887 not found: ID does not exist" Jun 08 19:39:39.302133 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.302113 2562 scope.go:117] "RemoveContainer" containerID="fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec" Jun 08 19:39:39.302329 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.302309 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec"} err="failed to get container status \"fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec\": rpc error: code = NotFound desc = could not find container \"fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec\": container with ID starting with fc12ac654c4d509ce553fe79451956eeb1a2ec520c22caecc7f3d0ce247c20ec not found: ID does not exist" Jun 08 19:39:39.302329 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.302328 2562 scope.go:117] "RemoveContainer" containerID="da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192" Jun 08 19:39:39.302585 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.302568 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192"} err="failed to get container status \"da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192\": rpc error: code = NotFound desc = could not find container \"da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192\": container with ID starting with da6dc4dfab4a3772d220c368c8216e3eadcf5697730f8a695462ff203e218192 not found: ID does not exist" Jun 08 19:39:39.302640 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.302586 2562 scope.go:117] "RemoveContainer" containerID="54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058" Jun 08 19:39:39.302797 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.302782 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058"} err="failed to get container status \"54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058\": rpc error: code = NotFound desc = could not find container \"54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058\": container with ID starting with 54beae6e72ce73e3be1e8eab3af8eaee525248b6937d5d3f99d32d33cbd0f058 not found: ID does not exist" Jun 08 19:39:39.302843 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.302797 2562 scope.go:117] "RemoveContainer" containerID="ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7" Jun 08 19:39:39.303005 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.302989 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7"} err="failed to get container status \"ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7\": rpc error: code = NotFound desc = could not find container \"ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7\": container with ID starting with ad8063564a074fb7dc9f80d9943a5115e07db2cbfd0ce0a28541c6358e923fe7 not found: ID does not exist" Jun 08 19:39:39.303048 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.303005 2562 scope.go:117] "RemoveContainer" containerID="4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303" Jun 08 19:39:39.303210 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.303194 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303"} err="failed to get container status \"4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303\": rpc error: code = NotFound desc = could not find container \"4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303\": container with ID starting with 4236a0a8db8e52324d2fa57774c2af5a76628c436d6521566c182afddb376303 not found: ID does not exist" Jun 08 19:39:39.303264 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.303210 2562 scope.go:117] "RemoveContainer" containerID="b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca" Jun 08 19:39:39.303389 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.303374 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca"} err="failed to get container status \"b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca\": rpc error: code = NotFound desc = could not find container \"b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca\": container with ID starting with b17a55400c75cd9d2772e4b808a905d622761a4444091bb5be8e71ea214fe1ca not found: ID does not exist" Jun 08 19:39:39.303456 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.303389 2562 scope.go:117] "RemoveContainer" containerID="b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887" Jun 08 19:39:39.303570 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.303553 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887"} err="failed to get container status \"b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887\": rpc error: code = NotFound desc = could not find container \"b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887\": container with ID starting with b7bf28a10a68c01c1ba462cac4bd96e068294cd2ed853b552d2c8f1a2308a887 not found: ID does not exist" Jun 08 19:39:39.309513 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309493 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:39:39.309757 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309745 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="alertmanager" Jun 08 19:39:39.309794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309758 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="alertmanager" Jun 08 19:39:39.309794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309771 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy" Jun 08 19:39:39.309794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309776 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy" Jun 08 19:39:39.309794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309784 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="init-config-reloader" Jun 08 19:39:39.309794 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309790 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="init-config-reloader" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309798 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy-metric" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309804 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy-metric" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309812 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="prom-label-proxy" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309817 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="prom-label-proxy" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309829 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="config-reloader" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309834 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="config-reloader" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309841 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy-web" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309846 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy-web" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309888 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy-metric" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309896 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="config-reloader" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309903 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309910 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="prom-label-proxy" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309917 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="kube-rbac-proxy-web" Jun 08 19:39:39.309973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.309923 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" containerName="alertmanager" Jun 08 19:39:39.313408 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.313393 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.316167 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.316145 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 19:39:39.316167 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.316158 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 19:39:39.316374 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.316205 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 19:39:39.316374 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.316223 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 19:39:39.316374 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.316241 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 19:39:39.316374 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.316148 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ksgzf\"" Jun 08 19:39:39.316626 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.316524 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 19:39:39.316626 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.316538 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 19:39:39.316626 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.316581 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 19:39:39.321549 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.321528 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 19:39:39.333390 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.333359 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:39:39.391198 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4zn6\" (UniqueName: \"kubernetes.io/projected/85b6fd7e-aaa4-4918-a214-e5240a6cde80-kube-api-access-v4zn6\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391198 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391198 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-config-volume\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-web-config\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85b6fd7e-aaa4-4918-a214-e5240a6cde80-config-out\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85b6fd7e-aaa4-4918-a214-e5240a6cde80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391746 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85b6fd7e-aaa4-4918-a214-e5240a6cde80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391746 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85b6fd7e-aaa4-4918-a214-e5240a6cde80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391746 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391746 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b6fd7e-aaa4-4918-a214-e5240a6cde80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.391746 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.391679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.492659 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.492617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b6fd7e-aaa4-4918-a214-e5240a6cde80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.492659 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.492666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.492901 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.492698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zn6\" (UniqueName: \"kubernetes.io/projected/85b6fd7e-aaa4-4918-a214-e5240a6cde80-kube-api-access-v4zn6\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.492901 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.492728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493002 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.492945 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-config-volume\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493002 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.492988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-web-config\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493148 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.493118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85b6fd7e-aaa4-4918-a214-e5240a6cde80-config-out\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493242 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.493166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493242 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.493193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85b6fd7e-aaa4-4918-a214-e5240a6cde80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493242 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.493221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493411 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.493277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85b6fd7e-aaa4-4918-a214-e5240a6cde80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493411 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.493312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85b6fd7e-aaa4-4918-a214-e5240a6cde80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493411 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.493333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.493850 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.493823 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85b6fd7e-aaa4-4918-a214-e5240a6cde80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.495827 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.495796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.495995 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.495877 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-web-config\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.495995 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.495969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.496114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.496080 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85b6fd7e-aaa4-4918-a214-e5240a6cde80-config-out\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.496114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.496092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.496204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.496140 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85b6fd7e-aaa4-4918-a214-e5240a6cde80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.496204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.496150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.496373 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.496351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85b6fd7e-aaa4-4918-a214-e5240a6cde80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.496539 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.496519 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-config-volume\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.496590 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.496519 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85b6fd7e-aaa4-4918-a214-e5240a6cde80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.497857 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.497836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85b6fd7e-aaa4-4918-a214-e5240a6cde80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.501288 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.501256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4zn6\" (UniqueName: \"kubernetes.io/projected/85b6fd7e-aaa4-4918-a214-e5240a6cde80-kube-api-access-v4zn6\") pod \"alertmanager-main-0\" (UID: \"85b6fd7e-aaa4-4918-a214-e5240a6cde80\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.623676 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.623635 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 19:39:39.763671 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.763642 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 19:39:39.765274 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:39:39.765254 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b6fd7e_aaa4_4918_a214_e5240a6cde80.slice/crio-20b2d5de2d133b2fb9b9748d96dd6fb50abc09eb9ef6f7ab749a6d57a1ccb53a WatchSource:0}: Error finding container 20b2d5de2d133b2fb9b9748d96dd6fb50abc09eb9ef6f7ab749a6d57a1ccb53a: Status 404 returned error can't find the container with id 20b2d5de2d133b2fb9b9748d96dd6fb50abc09eb9ef6f7ab749a6d57a1ccb53a Jun 08 19:39:39.919698 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:39.919664 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a8622f4-fe5a-44e8-9e22-bebdb943eb37" path="/var/lib/kubelet/pods/8a8622f4-fe5a-44e8-9e22-bebdb943eb37/volumes" Jun 08 19:39:40.250788 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:40.250746 2562 generic.go:356] "Generic (PLEG): container finished" podID="85b6fd7e-aaa4-4918-a214-e5240a6cde80" containerID="f7e80a91d18c50c5fb028a1d1f124dd6ccdd9d6c01a1381b899914e5812562e8" exitCode=0 Jun 08 19:39:40.251221 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:40.250829 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85b6fd7e-aaa4-4918-a214-e5240a6cde80","Type":"ContainerDied","Data":"f7e80a91d18c50c5fb028a1d1f124dd6ccdd9d6c01a1381b899914e5812562e8"} Jun 08 19:39:40.251221 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:40.250932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85b6fd7e-aaa4-4918-a214-e5240a6cde80","Type":"ContainerStarted","Data":"20b2d5de2d133b2fb9b9748d96dd6fb50abc09eb9ef6f7ab749a6d57a1ccb53a"} Jun 08 19:39:41.258675 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:41.258635 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85b6fd7e-aaa4-4918-a214-e5240a6cde80","Type":"ContainerStarted","Data":"a97a1f6fab8dec5b0c437a4bc59f8bee5c80e30d679145d08875242e51d09b9d"} Jun 08 19:39:41.259241 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:41.258735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85b6fd7e-aaa4-4918-a214-e5240a6cde80","Type":"ContainerStarted","Data":"b019c455227dabfc7f82e139a873092cb2d488fc89ab817328f2ec067720b596"} Jun 08 19:39:41.259241 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:41.258762 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85b6fd7e-aaa4-4918-a214-e5240a6cde80","Type":"ContainerStarted","Data":"c624d873777941e49c9d6b5a8a3a512c5e44b5742715bc8186c88d3f41e1250a"} Jun 08 19:39:41.259241 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:41.258786 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85b6fd7e-aaa4-4918-a214-e5240a6cde80","Type":"ContainerStarted","Data":"ab8e5103bceccf786fe1c1fc394763dc3ef15094fad93c2f8232ac5829568ccb"} Jun 08 19:39:41.259241 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:41.258810 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85b6fd7e-aaa4-4918-a214-e5240a6cde80","Type":"ContainerStarted","Data":"a0f2cb5994251cc65a566d47695c3ac88315713bd88634c43029830bb66daf0e"} Jun 08 19:39:41.259241 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:41.258832 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85b6fd7e-aaa4-4918-a214-e5240a6cde80","Type":"ContainerStarted","Data":"e7ddc1481a08086cf2ba49298b4857a3248d67ba419afa25d4e323f61596d061"} Jun 08 19:39:41.290627 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:41.290573 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.271887245 podStartE2EDuration="2.290558176s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.670931ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:39:41.288485464 +0000 UTC m=+367.843505929" watchObservedRunningTime="2026-06-08 19:39:41.290558176 +0000 UTC m=+367.845578676" Jun 08 19:39:42.097979 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.097941 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:39:42.098277 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.098230 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="prometheus" containerID="cri-o://d7f919546cc42282334babec1ec6b03073f3619cdd57b7243b7a4cc223e1f897" gracePeriod=600 Jun 08 19:39:42.098421 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.098285 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="thanos-sidecar" containerID="cri-o://0fc2b9278d60fe79acf4148a1250768951513ef6ab54c41423db4306fc3ddc17" gracePeriod=600 Jun 08 19:39:42.098421 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.098287 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8f9b63780f502347b2d9ab41e8dea47491d75c8239c3f6d259f78248d5eae91f" gracePeriod=600 Jun 08 19:39:42.098421 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.098263 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy" containerID="cri-o://b3c12503580f13d2df4503a09056b1ccdf0780f11c2f7ad378c85c4f7697b592" gracePeriod=600 Jun 08 19:39:42.098421 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.098312 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="config-reloader" containerID="cri-o://8320c8fe397ede11b73fb6353c1f43b861573b69ee30a2e1b8b217161d453b8b" gracePeriod=600 Jun 08 19:39:42.098645 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.098296 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy-web" containerID="cri-o://f09922f149500bedc42f4e94021de0f92837a6a7757f3b8b032dadf22c222475" gracePeriod=600 Jun 08 19:39:42.265921 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.265888 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerID="8f9b63780f502347b2d9ab41e8dea47491d75c8239c3f6d259f78248d5eae91f" exitCode=0 Jun 08 19:39:42.265921 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.265912 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerID="b3c12503580f13d2df4503a09056b1ccdf0780f11c2f7ad378c85c4f7697b592" exitCode=0 Jun 08 19:39:42.265921 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.265918 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerID="0fc2b9278d60fe79acf4148a1250768951513ef6ab54c41423db4306fc3ddc17" exitCode=0 Jun 08 19:39:42.265921 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.265924 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerID="8320c8fe397ede11b73fb6353c1f43b861573b69ee30a2e1b8b217161d453b8b" exitCode=0 Jun 08 19:39:42.265921 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.265930 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerID="d7f919546cc42282334babec1ec6b03073f3619cdd57b7243b7a4cc223e1f897" exitCode=0 Jun 08 19:39:42.266398 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.265956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerDied","Data":"8f9b63780f502347b2d9ab41e8dea47491d75c8239c3f6d259f78248d5eae91f"} Jun 08 19:39:42.266398 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.266028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerDied","Data":"b3c12503580f13d2df4503a09056b1ccdf0780f11c2f7ad378c85c4f7697b592"} Jun 08 19:39:42.266398 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.266068 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerDied","Data":"0fc2b9278d60fe79acf4148a1250768951513ef6ab54c41423db4306fc3ddc17"} Jun 08 19:39:42.266398 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.266106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerDied","Data":"8320c8fe397ede11b73fb6353c1f43b861573b69ee30a2e1b8b217161d453b8b"} Jun 08 19:39:42.266398 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:42.266143 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerDied","Data":"d7f919546cc42282334babec1ec6b03073f3619cdd57b7243b7a4cc223e1f897"} Jun 08 19:39:43.273694 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.273664 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerID="f09922f149500bedc42f4e94021de0f92837a6a7757f3b8b032dadf22c222475" exitCode=0 Jun 08 19:39:43.274050 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.273705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerDied","Data":"f09922f149500bedc42f4e94021de0f92837a6a7757f3b8b032dadf22c222475"} Jun 08 19:39:43.347701 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.347677 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:43.426869 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.426790 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-grpc-tls\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.426869 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.426823 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config-out\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.426869 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.426848 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-1\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.426869 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.426866 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-kube-rbac-proxy\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.426883 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-2\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.426899 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-0\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.426929 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-tls-assets\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.426966 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.426994 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-tls\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427019 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-thanos-prometheus-http-client-file\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427055 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-trusted-ca-bundle\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427116 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g7r8\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-kube-api-access-4g7r8\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427144 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427176 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427172 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-metrics-client-certs\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427703 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427209 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-serving-certs-ca-bundle\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427703 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427247 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427703 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427256 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:43.427703 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427283 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-web-config\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.427703 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427266 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:43.427993 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.427966 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-kubelet-serving-ca-bundle\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.428063 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.428043 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-metrics-client-ca\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.428087 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-db\") pod \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\" (UID: \"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198\") " Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.428364 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.428536 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.428605 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.428666 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.428686 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.428701 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.428716 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.429079 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:43.429969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.429930 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:39:43.430780 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.430196 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:39:43.430866 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.430825 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:43.431392 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.431356 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:43.432241 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.432204 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:43.432424 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.432385 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:39:43.432424 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.432401 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config" (OuterVolumeSpecName: "config") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:43.432580 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.432480 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:43.433297 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.433264 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config-out" (OuterVolumeSpecName: "config-out") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:39:43.433395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.433354 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:43.433395 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.433359 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-kube-api-access-4g7r8" (OuterVolumeSpecName: "kube-api-access-4g7r8") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "kube-api-access-4g7r8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:39:43.433592 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.433495 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:43.433921 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.433894 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:43.441544 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.441515 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-web-config" (OuterVolumeSpecName: "web-config") pod "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" (UID: "6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 19:39:43.530149 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530114 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530149 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530143 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530149 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530153 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530149 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530163 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530172 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g7r8\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-kube-api-access-4g7r8\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530180 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530188 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-metrics-client-certs\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530198 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530206 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-web-config\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530214 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-configmap-metrics-client-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530222 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-db\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530230 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-grpc-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530238 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-config-out\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530246 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-secret-kube-rbac-proxy\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530254 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:43.530407 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:43.530262 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198-tls-assets\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:39:44.280324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.280240 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198","Type":"ContainerDied","Data":"2568dd07b7f8a4a47773c81e09d3481d7147739a577bdb6009b646eadad9df17"} Jun 08 19:39:44.280324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.280284 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.280779 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.280349 2562 scope.go:117] "RemoveContainer" containerID="8f9b63780f502347b2d9ab41e8dea47491d75c8239c3f6d259f78248d5eae91f" Jun 08 19:39:44.288285 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.288245 2562 scope.go:117] "RemoveContainer" containerID="b3c12503580f13d2df4503a09056b1ccdf0780f11c2f7ad378c85c4f7697b592" Jun 08 19:39:44.295246 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.295229 2562 scope.go:117] "RemoveContainer" containerID="f09922f149500bedc42f4e94021de0f92837a6a7757f3b8b032dadf22c222475" Jun 08 19:39:44.301766 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.301750 2562 scope.go:117] "RemoveContainer" containerID="0fc2b9278d60fe79acf4148a1250768951513ef6ab54c41423db4306fc3ddc17" Jun 08 19:39:44.303825 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.303803 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:39:44.308741 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.308724 2562 scope.go:117] "RemoveContainer" containerID="8320c8fe397ede11b73fb6353c1f43b861573b69ee30a2e1b8b217161d453b8b" Jun 08 19:39:44.310170 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.310151 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:39:44.315313 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.315292 2562 scope.go:117] "RemoveContainer" containerID="d7f919546cc42282334babec1ec6b03073f3619cdd57b7243b7a4cc223e1f897" Jun 08 19:39:44.324458 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.324410 2562 scope.go:117] "RemoveContainer" containerID="9f91bbb3e744ae580aa425bc23e174a3aa1da2e7bbaad579f71b9e4f1ce7f720" Jun 08 19:39:44.339200 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339177 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:39:44.339502 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339488 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy" Jun 08 19:39:44.339551 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339503 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy" Jun 08 19:39:44.339551 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339514 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="prometheus" Jun 08 19:39:44.339551 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339519 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="prometheus" Jun 08 19:39:44.339551 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339525 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="config-reloader" Jun 08 19:39:44.339551 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339530 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="config-reloader" Jun 08 19:39:44.339551 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339536 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="thanos-sidecar" Jun 08 19:39:44.339551 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339541 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="thanos-sidecar" Jun 08 19:39:44.339551 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339550 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy-thanos" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339555 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy-thanos" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339565 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="init-config-reloader" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339570 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="init-config-reloader" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339582 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy-web" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339587 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy-web" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339638 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="thanos-sidecar" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339647 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy-thanos" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339653 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="prometheus" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339661 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="config-reloader" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339667 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy" Jun 08 19:39:44.339815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.339673 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" containerName="kube-rbac-proxy-web" Jun 08 19:39:44.343651 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.343634 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.346754 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.346736 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 19:39:44.346754 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.346748 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-851n0ro0lbsjl\"" Jun 08 19:39:44.347250 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.347232 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 19:39:44.347353 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.347316 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 19:39:44.347463 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.347447 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 19:39:44.347548 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.347490 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 19:39:44.347548 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.347516 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 19:39:44.347821 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.347805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 19:39:44.347881 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.347819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 19:39:44.348253 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.348237 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w7hg9\"" Jun 08 19:39:44.348340 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.348251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 19:39:44.348340 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.348323 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 19:39:44.348340 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.348251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 19:39:44.348607 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.348591 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 19:39:44.348831 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.348818 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 19:39:44.350281 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.350156 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 19:39:44.353653 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.353636 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 19:39:44.369391 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.369364 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:39:44.437539 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.437539 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.437769 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.437769 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.437769 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.437769 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-config\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.437769 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.437769 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.437769 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjpv\" (UniqueName: \"kubernetes.io/projected/be55592c-b758-4267-b309-634b1644bafd-kube-api-access-hcjpv\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be55592c-b758-4267-b309-634b1644bafd-config-out\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be55592c-b758-4267-b309-634b1644bafd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437943 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.437977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.438011 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.438038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.438485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.438087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-web-config\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.538854 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.538747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.538854 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.538810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.538854 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.538838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.538875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.538900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.538931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-config\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.538957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539114 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjpv\" (UniqueName: \"kubernetes.io/projected/be55592c-b758-4267-b309-634b1644bafd-kube-api-access-hcjpv\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539546 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be55592c-b758-4267-b309-634b1644bafd-config-out\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539546 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539546 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be55592c-b758-4267-b309-634b1644bafd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539546 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539546 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539546 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539546 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539546 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539546 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-web-config\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.539990 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.539821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.540120 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.540097 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.540529 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.540505 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.540754 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.540730 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.540841 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.540808 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.541361 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.541326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.542626 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.541951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.542626 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.542047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.542626 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.542355 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.542626 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.542416 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.543385 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.543043 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-web-config\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.543385 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.543334 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.543577 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.543446 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-config\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.543763 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.543741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be55592c-b758-4267-b309-634b1644bafd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.544026 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.544005 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.544725 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.544705 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.544901 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.544880 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be55592c-b758-4267-b309-634b1644bafd-config-out\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.545295 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.545277 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be55592c-b758-4267-b309-634b1644bafd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.545604 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.545584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be55592c-b758-4267-b309-634b1644bafd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.551389 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.551363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjpv\" (UniqueName: \"kubernetes.io/projected/be55592c-b758-4267-b309-634b1644bafd-kube-api-access-hcjpv\") pod \"prometheus-k8s-0\" (UID: \"be55592c-b758-4267-b309-634b1644bafd\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.653052 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.653016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:39:44.803872 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:44.803788 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 19:39:44.806560 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:39:44.806532 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe55592c_b758_4267_b309_634b1644bafd.slice/crio-d33c9433eb8aad0b3a49369c178eeaa29659c14413c6afc8a2bfa9ca69ec62f8 WatchSource:0}: Error finding container d33c9433eb8aad0b3a49369c178eeaa29659c14413c6afc8a2bfa9ca69ec62f8: Status 404 returned error can't find the container with id d33c9433eb8aad0b3a49369c178eeaa29659c14413c6afc8a2bfa9ca69ec62f8 Jun 08 19:39:45.286336 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:45.286306 2562 generic.go:356] "Generic (PLEG): container finished" podID="be55592c-b758-4267-b309-634b1644bafd" containerID="73cc086bb06e0f3042e17bc83467dcd869ef39041d064f1be0361238dfda7f4f" exitCode=0 Jun 08 19:39:45.286763 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:45.286387 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be55592c-b758-4267-b309-634b1644bafd","Type":"ContainerDied","Data":"73cc086bb06e0f3042e17bc83467dcd869ef39041d064f1be0361238dfda7f4f"} Jun 08 19:39:45.286763 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:45.286509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be55592c-b758-4267-b309-634b1644bafd","Type":"ContainerStarted","Data":"d33c9433eb8aad0b3a49369c178eeaa29659c14413c6afc8a2bfa9ca69ec62f8"} Jun 08 19:39:45.919590 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:45.919558 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198" path="/var/lib/kubelet/pods/6d6e81d9-3d2e-4e58-bd8a-9d7dc540e198/volumes" Jun 08 19:39:46.294150 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:46.294064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be55592c-b758-4267-b309-634b1644bafd","Type":"ContainerStarted","Data":"bc4053a4769179eb9ce8eaf1d14d81b08a2d8e0868cb1d2683b4fe9af8c5dc2b"} Jun 08 19:39:46.294150 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:46.294130 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be55592c-b758-4267-b309-634b1644bafd","Type":"ContainerStarted","Data":"637b6d8c3f3e360c70ece6c6278a7ba468fdbc71cdb057933e74914fe24be26d"} Jun 08 19:39:46.294557 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:46.294155 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be55592c-b758-4267-b309-634b1644bafd","Type":"ContainerStarted","Data":"b645b46d187d1084dad8d795724c95b0036487f8df05216c35f8fa9840f3f6f8"} Jun 08 19:39:46.294557 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:46.294192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be55592c-b758-4267-b309-634b1644bafd","Type":"ContainerStarted","Data":"f0a9174d0d2a6de484b0beeef97387981fdd61ad8fdc0c7e90ef837868982848"} Jun 08 19:39:46.294557 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:46.294214 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be55592c-b758-4267-b309-634b1644bafd","Type":"ContainerStarted","Data":"a0225f1b70e94eae0c1dfa3ac7e335dfc9c699c7b542e829deac622086db625f"} Jun 08 19:39:46.294557 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:46.294236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be55592c-b758-4267-b309-634b1644bafd","Type":"ContainerStarted","Data":"ee3a2cc10a0e6213ea19b77c8558c484e62bb86baf42e39e3f4206af303f7ebc"} Jun 08 19:39:46.328329 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:46.328272 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.305587776 podStartE2EDuration="2.328252536s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.66476ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:39:46.32679607 +0000 UTC m=+372.881816536" watchObservedRunningTime="2026-06-08 19:39:46.328252536 +0000 UTC m=+372.883273003" Jun 08 19:39:47.768137 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:47.768100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:39:47.770485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:47.770459 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e47a3-7e09-414e-b7b2-0d927ad09de8-metrics-certs\") pod \"network-metrics-daemon-6qp7m\" (UID: \"930e47a3-7e09-414e-b7b2-0d927ad09de8\") " pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:39:47.918084 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:47.918053 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kkkgg\"" Jun 08 19:39:47.925628 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:47.925601 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qp7m" Jun 08 19:39:48.066233 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:48.066210 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qp7m"] Jun 08 19:39:48.068359 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:39:48.068326 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod930e47a3_7e09_414e_b7b2_0d927ad09de8.slice/crio-d44d79862c8a35e7cdbdf669e85129adb98814a6f3faa18966f9dcc46733b4ad WatchSource:0}: Error finding container d44d79862c8a35e7cdbdf669e85129adb98814a6f3faa18966f9dcc46733b4ad: Status 404 returned error can't find the container with id d44d79862c8a35e7cdbdf669e85129adb98814a6f3faa18966f9dcc46733b4ad Jun 08 19:39:48.070313 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:48.070300 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:39:48.304950 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:48.304911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qp7m" event={"ID":"930e47a3-7e09-414e-b7b2-0d927ad09de8","Type":"ContainerStarted","Data":"d44d79862c8a35e7cdbdf669e85129adb98814a6f3faa18966f9dcc46733b4ad"} Jun 08 19:39:49.310447 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:49.310341 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qp7m" event={"ID":"930e47a3-7e09-414e-b7b2-0d927ad09de8","Type":"ContainerStarted","Data":"12cada4d0ad0d1bd636775f58a6c0b482f9ed1f50cc1eb162de9762f3286bc89"} Jun 08 19:39:49.310447 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:49.310404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qp7m" event={"ID":"930e47a3-7e09-414e-b7b2-0d927ad09de8","Type":"ContainerStarted","Data":"c67c2adf3673ac63301284955dbc93f944ee3f680f65f378477d0d2bbee59c2c"} Jun 08 19:39:49.333249 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:49.329666 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6qp7m" podStartSLOduration=374.468858384 podStartE2EDuration="6m15.329645838s" totalImagesPullingTime="860.787454ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:39:49.328835177 +0000 UTC m=+375.883855640" watchObservedRunningTime="2026-06-08 19:39:49.329645838 +0000 UTC m=+375.884666305" Jun 08 19:39:49.653239 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:39:49.653200 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:40:44.654261 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:40:44.654202 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:40:44.669505 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:40:44.669478 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:40:45.553651 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:40:45.553622 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 19:43:08.108297 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.108266 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb"] Jun 08 19:43:08.111516 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.111498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.114328 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.114303 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 19:43:08.114567 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.114546 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 19:43:08.114631 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.114581 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 19:43:08.114681 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.114639 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mxs88\"" Jun 08 19:43:08.115422 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.115407 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 19:43:08.129498 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.129474 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb"] Jun 08 19:43:08.241234 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.241199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a9e964-18be-47c1-8d33-fef00907ca5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.241234 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.241242 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5glrt\" (UniqueName: \"kubernetes.io/projected/24a9e964-18be-47c1-8d33-fef00907ca5c-kube-api-access-5glrt\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.241483 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.241270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24a9e964-18be-47c1-8d33-fef00907ca5c-manifests\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.241483 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.241317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24a9e964-18be-47c1-8d33-fef00907ca5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.241483 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.241399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24a9e964-18be-47c1-8d33-fef00907ca5c-tmp\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.342275 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.342235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24a9e964-18be-47c1-8d33-fef00907ca5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.342485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.342294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24a9e964-18be-47c1-8d33-fef00907ca5c-tmp\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.342485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.342327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a9e964-18be-47c1-8d33-fef00907ca5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.342485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.342351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5glrt\" (UniqueName: \"kubernetes.io/projected/24a9e964-18be-47c1-8d33-fef00907ca5c-kube-api-access-5glrt\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.342485 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.342370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24a9e964-18be-47c1-8d33-fef00907ca5c-manifests\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.342829 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.342811 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24a9e964-18be-47c1-8d33-fef00907ca5c-manifests\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.344688 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.344655 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24a9e964-18be-47c1-8d33-fef00907ca5c-tmp\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.344808 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.344778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a9e964-18be-47c1-8d33-fef00907ca5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.344871 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.344854 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24a9e964-18be-47c1-8d33-fef00907ca5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.350726 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.350707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5glrt\" (UniqueName: \"kubernetes.io/projected/24a9e964-18be-47c1-8d33-fef00907ca5c-kube-api-access-5glrt\") pod \"opendatahub-operator-controller-manager-86b897fbc-wl2zb\" (UID: \"24a9e964-18be-47c1-8d33-fef00907ca5c\") " pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.421856 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.421772 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:08.559323 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:08.559301 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb"] Jun 08 19:43:08.561624 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:43:08.561591 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a9e964_18be_47c1_8d33_fef00907ca5c.slice/crio-6f75ef020b9446185f05796da811d3b4db6ac9130a9e6ed3f51c5a371256590d WatchSource:0}: Error finding container 6f75ef020b9446185f05796da811d3b4db6ac9130a9e6ed3f51c5a371256590d: Status 404 returned error can't find the container with id 6f75ef020b9446185f05796da811d3b4db6ac9130a9e6ed3f51c5a371256590d Jun 08 19:43:09.099076 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:09.099032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" event={"ID":"24a9e964-18be-47c1-8d33-fef00907ca5c","Type":"ContainerStarted","Data":"6f75ef020b9446185f05796da811d3b4db6ac9130a9e6ed3f51c5a371256590d"} Jun 08 19:43:12.115205 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:12.115166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" event={"ID":"24a9e964-18be-47c1-8d33-fef00907ca5c","Type":"ContainerStarted","Data":"a84b3cfb240ac5949b254b59c4a284ffd0ed91f43ff428ea77fe54a83bb9a222"} Jun 08 19:43:13.120976 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:13.120940 2562 generic.go:356] "Generic (PLEG): container finished" podID="24a9e964-18be-47c1-8d33-fef00907ca5c" containerID="a84b3cfb240ac5949b254b59c4a284ffd0ed91f43ff428ea77fe54a83bb9a222" exitCode=0 Jun 08 19:43:13.121379 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:13.121024 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" event={"ID":"24a9e964-18be-47c1-8d33-fef00907ca5c","Type":"ContainerDied","Data":"a84b3cfb240ac5949b254b59c4a284ffd0ed91f43ff428ea77fe54a83bb9a222"} Jun 08 19:43:14.126944 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:14.126906 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" event={"ID":"24a9e964-18be-47c1-8d33-fef00907ca5c","Type":"ContainerStarted","Data":"57621926a88c40d7929cf49d74fab6a597583bfc9d2a2a29029a8570ea64cc06"} Jun 08 19:43:14.127334 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:14.127015 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:14.150851 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:14.150793 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" podStartSLOduration=1.9145330390000002 podStartE2EDuration="6.150776255s" totalImagesPullingTime="3.303204905s" totalInitContainerRuntime="933.038311ms" isStatefulPod=false podCreationTimestamp="2026-06-08 19:43:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:43:14.148405246 +0000 UTC m=+580.703425731" watchObservedRunningTime="2026-06-08 19:43:14.150776255 +0000 UTC m=+580.705796721" Jun 08 19:43:25.133550 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:25.133508 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86b897fbc-wl2zb" Jun 08 19:43:33.897303 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:33.897256 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:43:33.901411 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:33.901386 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:43:33.908802 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:33.908771 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:43:33.913051 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:33.913025 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:43:37.401022 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.400987 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh"] Jun 08 19:43:37.403087 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.403067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.407221 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.407199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 19:43:37.407327 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.407227 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 19:43:37.407702 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.407676 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 19:43:37.410960 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.410937 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 19:43:37.413815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.411085 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 19:43:37.413815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.411248 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m6tdx\"" Jun 08 19:43:37.417360 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.417325 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh"] Jun 08 19:43:37.496343 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.496308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzvxs\" (UniqueName: \"kubernetes.io/projected/8d291359-c4d4-4836-b93b-1fede6ca7a67-kube-api-access-rzvxs\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.496543 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.496366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d291359-c4d4-4836-b93b-1fede6ca7a67-metrics-cert\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.496543 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.496480 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8d291359-c4d4-4836-b93b-1fede6ca7a67-manager-config\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.496543 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.496511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d291359-c4d4-4836-b93b-1fede6ca7a67-cert\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.597242 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.597203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzvxs\" (UniqueName: \"kubernetes.io/projected/8d291359-c4d4-4836-b93b-1fede6ca7a67-kube-api-access-rzvxs\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.597419 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.597257 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d291359-c4d4-4836-b93b-1fede6ca7a67-metrics-cert\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.597419 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.597286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8d291359-c4d4-4836-b93b-1fede6ca7a67-manager-config\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.597419 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.597302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d291359-c4d4-4836-b93b-1fede6ca7a67-cert\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.598127 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.598100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8d291359-c4d4-4836-b93b-1fede6ca7a67-manager-config\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.599900 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.599877 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d291359-c4d4-4836-b93b-1fede6ca7a67-metrics-cert\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.600051 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.600029 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d291359-c4d4-4836-b93b-1fede6ca7a67-cert\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.609365 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.609330 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzvxs\" (UniqueName: \"kubernetes.io/projected/8d291359-c4d4-4836-b93b-1fede6ca7a67-kube-api-access-rzvxs\") pod \"lws-controller-manager-5bdd5486f5-mwqsh\" (UID: \"8d291359-c4d4-4836-b93b-1fede6ca7a67\") " pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.716733 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.716640 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:37.847804 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:37.847771 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh"] Jun 08 19:43:37.850074 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:43:37.850048 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d291359_c4d4_4836_b93b_1fede6ca7a67.slice/crio-c3b49ecee8fd9913cb545cfc22fd5c9aefb136ea2f02af50f0347c90ec635ab5 WatchSource:0}: Error finding container c3b49ecee8fd9913cb545cfc22fd5c9aefb136ea2f02af50f0347c90ec635ab5: Status 404 returned error can't find the container with id c3b49ecee8fd9913cb545cfc22fd5c9aefb136ea2f02af50f0347c90ec635ab5 Jun 08 19:43:38.230330 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:38.230298 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" event={"ID":"8d291359-c4d4-4836-b93b-1fede6ca7a67","Type":"ContainerStarted","Data":"c3b49ecee8fd9913cb545cfc22fd5c9aefb136ea2f02af50f0347c90ec635ab5"} Jun 08 19:43:41.246497 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:41.246461 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" event={"ID":"8d291359-c4d4-4836-b93b-1fede6ca7a67","Type":"ContainerStarted","Data":"c67c73dcc0da936272d71f24c356aef5f254ddd54dcdf5bebcf91ea30a7a0cf9"} Jun 08 19:43:41.246908 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:41.246554 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:41.262560 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:41.262513 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" podStartSLOduration=1.82580029 podStartE2EDuration="4.262498952s" totalImagesPullingTime="2.436698662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:43:41.261848708 +0000 UTC m=+607.816869173" watchObservedRunningTime="2026-06-08 19:43:41.262498952 +0000 UTC m=+607.817519417" Jun 08 19:43:52.252969 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:52.252934 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bdd5486f5-mwqsh" Jun 08 19:43:59.188145 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.188110 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5"] Jun 08 19:43:59.190419 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.190399 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" Jun 08 19:43:59.193221 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.193198 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 19:43:59.193339 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.193228 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-84vb2\"" Jun 08 19:43:59.202993 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.202959 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5"] Jun 08 19:43:59.302309 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.302276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85zc\" (UniqueName: \"kubernetes.io/projected/8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9-kube-api-access-v85zc\") pod \"dashboard-redirect-7b9bfd4b8b-zkvn5\" (UID: \"8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9\") " pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" Jun 08 19:43:59.302309 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.302322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9-redirect-config\") pod \"dashboard-redirect-7b9bfd4b8b-zkvn5\" (UID: \"8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9\") " pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" Jun 08 19:43:59.403322 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.403286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85zc\" (UniqueName: \"kubernetes.io/projected/8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9-kube-api-access-v85zc\") pod \"dashboard-redirect-7b9bfd4b8b-zkvn5\" (UID: \"8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9\") " pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" Jun 08 19:43:59.403322 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.403328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9-redirect-config\") pod \"dashboard-redirect-7b9bfd4b8b-zkvn5\" (UID: \"8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9\") " pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" Jun 08 19:43:59.403996 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.403978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9-redirect-config\") pod \"dashboard-redirect-7b9bfd4b8b-zkvn5\" (UID: \"8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9\") " pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" Jun 08 19:43:59.417230 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.417185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85zc\" (UniqueName: \"kubernetes.io/projected/8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9-kube-api-access-v85zc\") pod \"dashboard-redirect-7b9bfd4b8b-zkvn5\" (UID: \"8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9\") " pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" Jun 08 19:43:59.504939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.504848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" Jun 08 19:43:59.635379 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:43:59.635350 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5"] Jun 08 19:43:59.637642 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:43:59.637615 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8276115d_f4a6_4ca7_a9d5_7c4129c3cfa9.slice/crio-aedfdba35cc1a0a8852044a0a9a19a2771f9b8e3a032a8e6ccf475b70f01548c WatchSource:0}: Error finding container aedfdba35cc1a0a8852044a0a9a19a2771f9b8e3a032a8e6ccf475b70f01548c: Status 404 returned error can't find the container with id aedfdba35cc1a0a8852044a0a9a19a2771f9b8e3a032a8e6ccf475b70f01548c Jun 08 19:44:00.325935 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:00.325894 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" event={"ID":"8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9","Type":"ContainerStarted","Data":"aedfdba35cc1a0a8852044a0a9a19a2771f9b8e3a032a8e6ccf475b70f01548c"} Jun 08 19:44:02.336266 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:02.336231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" event={"ID":"8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9","Type":"ContainerStarted","Data":"531bd83626fb97f3c3928de195bae4216afb0d4a63d088241b66162a780073cd"} Jun 08 19:44:02.353102 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:02.353048 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7b9bfd4b8b-zkvn5" podStartSLOduration=1.157131769 podStartE2EDuration="3.353030044s" totalImagesPullingTime="2.195898275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:44:02.351938165 +0000 UTC m=+628.906958665" watchObservedRunningTime="2026-06-08 19:44:02.353030044 +0000 UTC m=+628.908050509" Jun 08 19:44:03.408602 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.408570 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df"] Jun 08 19:44:03.411249 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.411232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.413793 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.413767 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 19:44:03.413950 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.413769 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 19:44:03.414115 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.414098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 19:44:03.414220 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.414200 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6lxvd\"" Jun 08 19:44:03.422454 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.422409 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df"] Jun 08 19:44:03.441891 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.441854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.441891 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.441902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.442132 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.441968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.442132 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.442041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.442132 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.442071 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.442132 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.442090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d0fba77-697f-4131-a9bd-16e824907a92-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.442132 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.442107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrzlr\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-kube-api-access-wrzlr\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.442327 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.442209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.442327 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.442254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d0fba77-697f-4131-a9bd-16e824907a92-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543003 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.542958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d0fba77-697f-4131-a9bd-16e824907a92-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrzlr\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-kube-api-access-wrzlr\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543544 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543544 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543544 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543544 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543469 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d0fba77-697f-4131-a9bd-16e824907a92-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543544 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543472 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543796 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.543949 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.543926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d0fba77-697f-4131-a9bd-16e824907a92-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.545360 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.545330 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.545747 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.545727 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d0fba77-697f-4131-a9bd-16e824907a92-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.551194 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.551170 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.551459 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.551416 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrzlr\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-kube-api-access-wrzlr\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.708384 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.708280 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76"] Jun 08 19:44:03.711282 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.711265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.722565 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.722544 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:03.727921 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.727897 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76"] Jun 08 19:44:03.744824 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.744539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.744824 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.744580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.744824 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.744627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.744824 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.744648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.744824 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.744685 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.744824 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.744708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.744824 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.744771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.744824 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.744809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.744824 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.744836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcr44\" (UniqueName: \"kubernetes.io/projected/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-kube-api-access-vcr44\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.845708 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.845675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.845886 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.845718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.845886 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.845746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcr44\" (UniqueName: \"kubernetes.io/projected/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-kube-api-access-vcr44\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.845886 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.845795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.845886 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.845820 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.845886 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.845859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.845886 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.845881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.846204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.845980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.846204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.846038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.846299 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.846223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.846393 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.846367 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.846477 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.846381 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.846628 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.846599 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.846739 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.846652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.848273 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.848249 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.848461 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.848441 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.855094 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.855057 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.855337 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.855317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcr44\" (UniqueName: \"kubernetes.io/projected/1e6bb836-f6c4-4327-95e4-6603bc8eabb1-kube-api-access-vcr44\") pod \"data-science-gateway-data-science-gateway-class-74759f97958qn76\" (UID: \"1e6bb836-f6c4-4327-95e4-6603bc8eabb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:03.860872 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:03.860851 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df"] Jun 08 19:44:03.863257 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:44:03.863235 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0fba77_697f_4131_a9bd_16e824907a92.slice/crio-0898540fad6fb830679abf03776b790d23ce9b9511054901d692000f12295d28 WatchSource:0}: Error finding container 0898540fad6fb830679abf03776b790d23ce9b9511054901d692000f12295d28: Status 404 returned error can't find the container with id 0898540fad6fb830679abf03776b790d23ce9b9511054901d692000f12295d28 Jun 08 19:44:04.021579 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:04.021493 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:04.166987 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:04.166946 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76"] Jun 08 19:44:04.170796 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:44:04.170767 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6bb836_f6c4_4327_95e4_6603bc8eabb1.slice/crio-e6e3092f4a9c144096e96e2468640b7b9eaf9f12529c28e5ab65e6b870cba53b WatchSource:0}: Error finding container e6e3092f4a9c144096e96e2468640b7b9eaf9f12529c28e5ab65e6b870cba53b: Status 404 returned error can't find the container with id e6e3092f4a9c144096e96e2468640b7b9eaf9f12529c28e5ab65e6b870cba53b Jun 08 19:44:04.346574 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:04.346523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" event={"ID":"1e6bb836-f6c4-4327-95e4-6603bc8eabb1","Type":"ContainerStarted","Data":"e6e3092f4a9c144096e96e2468640b7b9eaf9f12529c28e5ab65e6b870cba53b"} Jun 08 19:44:04.347695 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:04.347667 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" event={"ID":"2d0fba77-697f-4131-a9bd-16e824907a92","Type":"ContainerStarted","Data":"0898540fad6fb830679abf03776b790d23ce9b9511054901d692000f12295d28"} Jun 08 19:44:06.927018 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:06.926971 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:44:06.927321 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:06.927070 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:44:06.927321 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:06.927102 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:44:07.352940 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:07.352900 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:44:07.353041 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:07.352987 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:44:07.353041 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:07.353032 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:44:07.366708 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:07.366677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" event={"ID":"1e6bb836-f6c4-4327-95e4-6603bc8eabb1","Type":"ContainerStarted","Data":"87190d3423e185d0f512572e9f1368308505400acd4369bf1409f0612bdadf55"} Jun 08 19:44:07.386365 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:07.386293 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" podStartSLOduration=1.632447506 podStartE2EDuration="4.386274659s" totalImagesPullingTime="2.753827153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:44:07.386274221 +0000 UTC m=+633.941294687" watchObservedRunningTime="2026-06-08 19:44:07.386274659 +0000 UTC m=+633.941295125" Jun 08 19:44:08.022511 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.022471 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:08.026959 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.026930 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:08.373018 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.372975 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" event={"ID":"2d0fba77-697f-4131-a9bd-16e824907a92","Type":"ContainerStarted","Data":"f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340"} Jun 08 19:44:08.373337 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.373320 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:08.374063 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.374043 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958qn76" Jun 08 19:44:08.391495 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.391423 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" podStartSLOduration=1.904106713 podStartE2EDuration="5.391403653s" totalImagesPullingTime="3.48729694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:44:08.390993934 +0000 UTC m=+634.946014421" watchObservedRunningTime="2026-06-08 19:44:08.391403653 +0000 UTC m=+634.946424122" Jun 08 19:44:08.436592 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.436561 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df"] Jun 08 19:44:08.722997 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.722903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:08.724331 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.724301 2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jun 08 19:44:08.724473 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:08.724355 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" podUID="2d0fba77-697f-4131-a9bd-16e824907a92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jun 08 19:44:09.723740 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:09.723704 2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jun 08 19:44:09.724125 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:09.723766 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" podUID="2d0fba77-697f-4131-a9bd-16e824907a92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jun 08 19:44:10.382423 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:10.382376 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" podUID="2d0fba77-697f-4131-a9bd-16e824907a92" containerName="istio-proxy" containerID="cri-o://f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340" gracePeriod=30 Jun 08 19:44:15.638446 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.638406 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:15.756664 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756564 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-socket\") pod \"2d0fba77-697f-4131-a9bd-16e824907a92\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " Jun 08 19:44:15.756664 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756616 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-data\") pod \"2d0fba77-697f-4131-a9bd-16e824907a92\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " Jun 08 19:44:15.756664 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756634 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-credential-socket\") pod \"2d0fba77-697f-4131-a9bd-16e824907a92\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " Jun 08 19:44:15.756939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756667 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrzlr\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-kube-api-access-wrzlr\") pod \"2d0fba77-697f-4131-a9bd-16e824907a92\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " Jun 08 19:44:15.756939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d0fba77-697f-4131-a9bd-16e824907a92-istio-podinfo\") pod \"2d0fba77-697f-4131-a9bd-16e824907a92\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " Jun 08 19:44:15.756939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756724 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-envoy\") pod \"2d0fba77-697f-4131-a9bd-16e824907a92\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " Jun 08 19:44:15.756939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756758 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-certs\") pod \"2d0fba77-697f-4131-a9bd-16e824907a92\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " Jun 08 19:44:15.756939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756793 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-istio-token\") pod \"2d0fba77-697f-4131-a9bd-16e824907a92\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " Jun 08 19:44:15.756939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756825 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d0fba77-697f-4131-a9bd-16e824907a92-istiod-ca-cert\") pod \"2d0fba77-697f-4131-a9bd-16e824907a92\" (UID: \"2d0fba77-697f-4131-a9bd-16e824907a92\") " Jun 08 19:44:15.756939 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756907 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d0fba77-697f-4131-a9bd-16e824907a92" (UID: "2d0fba77-697f-4131-a9bd-16e824907a92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:44:15.757293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756944 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d0fba77-697f-4131-a9bd-16e824907a92" (UID: "2d0fba77-697f-4131-a9bd-16e824907a92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:44:15.757293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.756992 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d0fba77-697f-4131-a9bd-16e824907a92" (UID: "2d0fba77-697f-4131-a9bd-16e824907a92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:44:15.757293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.757123 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:15.757293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.757144 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-data\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:15.757293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.757159 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-credential-socket\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:15.757293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.757123 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d0fba77-697f-4131-a9bd-16e824907a92" (UID: "2d0fba77-697f-4131-a9bd-16e824907a92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:44:15.757293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.757249 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d0fba77-697f-4131-a9bd-16e824907a92-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d0fba77-697f-4131-a9bd-16e824907a92" (UID: "2d0fba77-697f-4131-a9bd-16e824907a92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 19:44:15.759136 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.759102 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d0fba77-697f-4131-a9bd-16e824907a92" (UID: "2d0fba77-697f-4131-a9bd-16e824907a92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:44:15.759267 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.759162 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-kube-api-access-wrzlr" (OuterVolumeSpecName: "kube-api-access-wrzlr") pod "2d0fba77-697f-4131-a9bd-16e824907a92" (UID: "2d0fba77-697f-4131-a9bd-16e824907a92"). InnerVolumeSpecName "kube-api-access-wrzlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:44:15.759326 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.759288 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d0fba77-697f-4131-a9bd-16e824907a92" (UID: "2d0fba77-697f-4131-a9bd-16e824907a92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 19:44:15.759390 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.759376 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d0fba77-697f-4131-a9bd-16e824907a92-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d0fba77-697f-4131-a9bd-16e824907a92" (UID: "2d0fba77-697f-4131-a9bd-16e824907a92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 08 19:44:15.858336 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.858294 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d0fba77-697f-4131-a9bd-16e824907a92-istiod-ca-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:15.858336 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.858328 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrzlr\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-kube-api-access-wrzlr\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:15.858336 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.858339 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d0fba77-697f-4131-a9bd-16e824907a92-istio-podinfo\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:15.858336 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.858348 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-istio-envoy\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:15.858641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.858357 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d0fba77-697f-4131-a9bd-16e824907a92-workload-certs\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:15.858641 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:15.858365 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d0fba77-697f-4131-a9bd-16e824907a92-istio-token\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:16.408878 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:16.408842 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d0fba77-697f-4131-a9bd-16e824907a92" containerID="f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340" exitCode=0 Jun 08 19:44:16.409068 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:16.408892 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" Jun 08 19:44:16.409068 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:16.408933 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" event={"ID":"2d0fba77-697f-4131-a9bd-16e824907a92","Type":"ContainerDied","Data":"f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340"} Jun 08 19:44:16.409068 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:16.408985 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df" event={"ID":"2d0fba77-697f-4131-a9bd-16e824907a92","Type":"ContainerDied","Data":"0898540fad6fb830679abf03776b790d23ce9b9511054901d692000f12295d28"} Jun 08 19:44:16.409068 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:16.409008 2562 scope.go:117] "RemoveContainer" containerID="f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340" Jun 08 19:44:16.417585 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:16.417567 2562 scope.go:117] "RemoveContainer" containerID="f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340" Jun 08 19:44:16.417830 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:44:16.417811 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340\": container with ID starting with f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340 not found: ID does not exist" containerID="f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340" Jun 08 19:44:16.417889 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:16.417838 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340"} err="failed to get container status \"f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340\": rpc error: code = NotFound desc = could not find container \"f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340\": container with ID starting with f805c73547c95f00186b2bf08f562e9826dc53036a76cd2aaa99f6ecc7b41340 not found: ID does not exist" Jun 08 19:44:16.427444 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:16.427405 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df"] Jun 08 19:44:16.430958 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:16.430937 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftk7df"] Jun 08 19:44:17.920229 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:17.920191 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d0fba77-697f-4131-a9bd-16e824907a92" path="/var/lib/kubelet/pods/2d0fba77-697f-4131-a9bd-16e824907a92/volumes" Jun 08 19:44:28.512884 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.512848 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-phdrj"] Jun 08 19:44:28.513278 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.513172 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d0fba77-697f-4131-a9bd-16e824907a92" containerName="istio-proxy" Jun 08 19:44:28.513278 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.513182 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d0fba77-697f-4131-a9bd-16e824907a92" containerName="istio-proxy" Jun 08 19:44:28.513278 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.513246 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d0fba77-697f-4131-a9bd-16e824907a92" containerName="istio-proxy" Jun 08 19:44:28.516159 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.516136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" Jun 08 19:44:28.518657 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.518633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d4q28\"" Jun 08 19:44:28.518776 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.518633 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 19:44:28.519777 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.519754 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 19:44:28.527632 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.527610 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-phdrj"] Jun 08 19:44:28.567532 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.567490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phs8x\" (UniqueName: \"kubernetes.io/projected/e1962f67-cca8-4132-84bc-234726454523-kube-api-access-phs8x\") pod \"kuadrant-operator-catalog-phdrj\" (UID: \"e1962f67-cca8-4132-84bc-234726454523\") " pod="kuadrant-system/kuadrant-operator-catalog-phdrj" Jun 08 19:44:28.669033 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.668980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phs8x\" (UniqueName: \"kubernetes.io/projected/e1962f67-cca8-4132-84bc-234726454523-kube-api-access-phs8x\") pod \"kuadrant-operator-catalog-phdrj\" (UID: \"e1962f67-cca8-4132-84bc-234726454523\") " pod="kuadrant-system/kuadrant-operator-catalog-phdrj" Jun 08 19:44:28.676607 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.676576 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phs8x\" (UniqueName: \"kubernetes.io/projected/e1962f67-cca8-4132-84bc-234726454523-kube-api-access-phs8x\") pod \"kuadrant-operator-catalog-phdrj\" (UID: \"e1962f67-cca8-4132-84bc-234726454523\") " pod="kuadrant-system/kuadrant-operator-catalog-phdrj" Jun 08 19:44:28.828200 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.828168 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" Jun 08 19:44:28.869202 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.869166 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-phdrj"] Jun 08 19:44:28.957586 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:28.957558 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-phdrj"] Jun 08 19:44:28.959654 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:44:28.959623 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1962f67_cca8_4132_84bc_234726454523.slice/crio-6566dc83f7124f2ece306eb73a52a8bb8a2e5d2ed23ac7239b7aa5c6f5c80e4f WatchSource:0}: Error finding container 6566dc83f7124f2ece306eb73a52a8bb8a2e5d2ed23ac7239b7aa5c6f5c80e4f: Status 404 returned error can't find the container with id 6566dc83f7124f2ece306eb73a52a8bb8a2e5d2ed23ac7239b7aa5c6f5c80e4f Jun 08 19:44:29.078896 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:29.078818 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5q2xt"] Jun 08 19:44:29.081883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:29.081866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" Jun 08 19:44:29.089630 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:29.089587 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5q2xt"] Jun 08 19:44:29.172950 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:29.172914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mnlv\" (UniqueName: \"kubernetes.io/projected/f2fb16e6-72a6-4006-a746-09b636a1c1ed-kube-api-access-5mnlv\") pod \"kuadrant-operator-catalog-5q2xt\" (UID: \"f2fb16e6-72a6-4006-a746-09b636a1c1ed\") " pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" Jun 08 19:44:29.273775 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:29.273738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mnlv\" (UniqueName: \"kubernetes.io/projected/f2fb16e6-72a6-4006-a746-09b636a1c1ed-kube-api-access-5mnlv\") pod \"kuadrant-operator-catalog-5q2xt\" (UID: \"f2fb16e6-72a6-4006-a746-09b636a1c1ed\") " pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" Jun 08 19:44:29.282127 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:29.282097 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mnlv\" (UniqueName: \"kubernetes.io/projected/f2fb16e6-72a6-4006-a746-09b636a1c1ed-kube-api-access-5mnlv\") pod \"kuadrant-operator-catalog-5q2xt\" (UID: \"f2fb16e6-72a6-4006-a746-09b636a1c1ed\") " pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" Jun 08 19:44:29.393357 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:29.393248 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" Jun 08 19:44:29.467353 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:29.467314 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" event={"ID":"e1962f67-cca8-4132-84bc-234726454523","Type":"ContainerStarted","Data":"6566dc83f7124f2ece306eb73a52a8bb8a2e5d2ed23ac7239b7aa5c6f5c80e4f"} Jun 08 19:44:29.530316 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:29.530216 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5q2xt"] Jun 08 19:44:29.573655 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:44:29.573619 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2fb16e6_72a6_4006_a746_09b636a1c1ed.slice/crio-b41cc3e786fdbfced88dee5b32de60fb958e05e3182fd38b5850d7d68f2f7f30 WatchSource:0}: Error finding container b41cc3e786fdbfced88dee5b32de60fb958e05e3182fd38b5850d7d68f2f7f30: Status 404 returned error can't find the container with id b41cc3e786fdbfced88dee5b32de60fb958e05e3182fd38b5850d7d68f2f7f30 Jun 08 19:44:30.474883 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:30.474808 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" event={"ID":"f2fb16e6-72a6-4006-a746-09b636a1c1ed","Type":"ContainerStarted","Data":"b41cc3e786fdbfced88dee5b32de60fb958e05e3182fd38b5850d7d68f2f7f30"} Jun 08 19:44:31.481095 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:31.480995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" event={"ID":"e1962f67-cca8-4132-84bc-234726454523","Type":"ContainerStarted","Data":"f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03"} Jun 08 19:44:31.481095 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:31.481046 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" podUID="e1962f67-cca8-4132-84bc-234726454523" containerName="registry-server" containerID="cri-o://f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03" gracePeriod=2 Jun 08 19:44:31.482535 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:31.482513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" event={"ID":"f2fb16e6-72a6-4006-a746-09b636a1c1ed","Type":"ContainerStarted","Data":"a29e8c591a9943cd347b476443461f21623511650900132e321728e093c34c9c"} Jun 08 19:44:31.503445 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:31.503377 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" podStartSLOduration=1.338085964 podStartE2EDuration="3.503361951s" totalImagesPullingTime="2.165275987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:44:31.501879461 +0000 UTC m=+658.056899941" watchObservedRunningTime="2026-06-08 19:44:31.503361951 +0000 UTC m=+658.058382416" Jun 08 19:44:31.517067 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:31.517014 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" podStartSLOduration=0.962824828 podStartE2EDuration="2.516998187s" totalImagesPullingTime="1.554173359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:44:31.516305959 +0000 UTC m=+658.071326426" watchObservedRunningTime="2026-06-08 19:44:31.516998187 +0000 UTC m=+658.072018652" Jun 08 19:44:31.726122 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:31.726095 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" Jun 08 19:44:31.796092 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:31.796001 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phs8x\" (UniqueName: \"kubernetes.io/projected/e1962f67-cca8-4132-84bc-234726454523-kube-api-access-phs8x\") pod \"e1962f67-cca8-4132-84bc-234726454523\" (UID: \"e1962f67-cca8-4132-84bc-234726454523\") " Jun 08 19:44:31.798189 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:31.798162 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1962f67-cca8-4132-84bc-234726454523-kube-api-access-phs8x" (OuterVolumeSpecName: "kube-api-access-phs8x") pod "e1962f67-cca8-4132-84bc-234726454523" (UID: "e1962f67-cca8-4132-84bc-234726454523"). InnerVolumeSpecName "kube-api-access-phs8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:44:31.897047 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:31.897009 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phs8x\" (UniqueName: \"kubernetes.io/projected/e1962f67-cca8-4132-84bc-234726454523-kube-api-access-phs8x\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:44:32.488382 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:32.488299 2562 generic.go:356] "Generic (PLEG): container finished" podID="e1962f67-cca8-4132-84bc-234726454523" containerID="f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03" exitCode=0 Jun 08 19:44:32.488382 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:32.488358 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" Jun 08 19:44:32.488866 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:32.488385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" event={"ID":"e1962f67-cca8-4132-84bc-234726454523","Type":"ContainerDied","Data":"f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03"} Jun 08 19:44:32.488866 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:32.488461 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-phdrj" event={"ID":"e1962f67-cca8-4132-84bc-234726454523","Type":"ContainerDied","Data":"6566dc83f7124f2ece306eb73a52a8bb8a2e5d2ed23ac7239b7aa5c6f5c80e4f"} Jun 08 19:44:32.488866 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:32.488490 2562 scope.go:117] "RemoveContainer" containerID="f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03" Jun 08 19:44:32.497336 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:32.497317 2562 scope.go:117] "RemoveContainer" containerID="f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03" Jun 08 19:44:32.497643 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:44:32.497624 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03\": container with ID starting with f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03 not found: ID does not exist" containerID="f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03" Jun 08 19:44:32.497700 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:32.497653 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03"} err="failed to get container status \"f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03\": rpc error: code = NotFound desc = could not find container \"f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03\": container with ID starting with f6d19cd52878aa6925c4020baeebb80a3e4e4c040f7441a47449823d70402b03 not found: ID does not exist" Jun 08 19:44:32.504617 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:32.504589 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-phdrj"] Jun 08 19:44:32.508330 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:32.508307 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-phdrj"] Jun 08 19:44:33.919997 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:33.919974 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1962f67-cca8-4132-84bc-234726454523" path="/var/lib/kubelet/pods/e1962f67-cca8-4132-84bc-234726454523/volumes" Jun 08 19:44:39.393934 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:39.393889 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" Jun 08 19:44:39.394359 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:39.393968 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" Jun 08 19:44:39.415288 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:39.415263 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" Jun 08 19:44:39.541534 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:39.541503 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5q2xt" Jun 08 19:44:54.590148 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.590113 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2"] Jun 08 19:44:54.590549 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.590478 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1962f67-cca8-4132-84bc-234726454523" containerName="registry-server" Jun 08 19:44:54.590549 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.590491 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1962f67-cca8-4132-84bc-234726454523" containerName="registry-server" Jun 08 19:44:54.590549 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.590546 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1962f67-cca8-4132-84bc-234726454523" containerName="registry-server" Jun 08 19:44:54.592693 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.592678 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:44:54.596951 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.596933 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8fh9t\"" Jun 08 19:44:54.621247 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.621220 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2"] Jun 08 19:44:54.700006 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.699971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c5zj\" (UniqueName: \"kubernetes.io/projected/e0a80629-a229-473e-b4e9-394dd70a5fe1-kube-api-access-6c5zj\") pod \"limitador-operator-controller-manager-859d7b78bd-9zlz2\" (UID: \"e0a80629-a229-473e-b4e9-394dd70a5fe1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:44:54.801174 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.801119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c5zj\" (UniqueName: \"kubernetes.io/projected/e0a80629-a229-473e-b4e9-394dd70a5fe1-kube-api-access-6c5zj\") pod \"limitador-operator-controller-manager-859d7b78bd-9zlz2\" (UID: \"e0a80629-a229-473e-b4e9-394dd70a5fe1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:44:54.813128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.813093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c5zj\" (UniqueName: \"kubernetes.io/projected/e0a80629-a229-473e-b4e9-394dd70a5fe1-kube-api-access-6c5zj\") pod \"limitador-operator-controller-manager-859d7b78bd-9zlz2\" (UID: \"e0a80629-a229-473e-b4e9-394dd70a5fe1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:44:54.901878 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:54.901794 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:44:55.064126 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:55.064102 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2"] Jun 08 19:44:55.066603 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:44:55.066573 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a80629_a229_473e_b4e9_394dd70a5fe1.slice/crio-ad7aa83829bdd472ed47a818fd1db30b4688bd5a658a051269ce7cd45be4e667 WatchSource:0}: Error finding container ad7aa83829bdd472ed47a818fd1db30b4688bd5a658a051269ce7cd45be4e667: Status 404 returned error can't find the container with id ad7aa83829bdd472ed47a818fd1db30b4688bd5a658a051269ce7cd45be4e667 Jun 08 19:44:55.069021 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:55.069003 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:44:55.592920 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:55.592887 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" event={"ID":"e0a80629-a229-473e-b4e9-394dd70a5fe1","Type":"ContainerStarted","Data":"ad7aa83829bdd472ed47a818fd1db30b4688bd5a658a051269ce7cd45be4e667"} Jun 08 19:44:57.607808 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:57.607776 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" event={"ID":"e0a80629-a229-473e-b4e9-394dd70a5fe1","Type":"ContainerStarted","Data":"0e9d2797a1f3411336c2132f40edaa481218dcb54e112bb61db9e98b4d15baef"} Jun 08 19:44:57.608186 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:57.607914 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:44:57.642482 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:57.642409 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" podStartSLOduration=2.07632807 podStartE2EDuration="3.642394372s" totalImagesPullingTime="1.566066302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:44:57.640207553 +0000 UTC m=+684.195228040" watchObservedRunningTime="2026-06-08 19:44:57.642394372 +0000 UTC m=+684.197414922" Jun 08 19:44:58.034901 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.034819 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt"] Jun 08 19:44:58.037170 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.037149 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" Jun 08 19:44:58.043141 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.043118 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lfkwt\"" Jun 08 19:44:58.045068 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.045051 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 19:44:58.056738 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.056715 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt"] Jun 08 19:44:58.132782 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.132749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c77jj\" (UniqueName: \"kubernetes.io/projected/143d070c-85fb-4315-82c1-ef2829ae24ab-kube-api-access-c77jj\") pod \"dns-operator-controller-manager-864dd78c4c-ljwdt\" (UID: \"143d070c-85fb-4315-82c1-ef2829ae24ab\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" Jun 08 19:44:58.233800 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.233765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c77jj\" (UniqueName: \"kubernetes.io/projected/143d070c-85fb-4315-82c1-ef2829ae24ab-kube-api-access-c77jj\") pod \"dns-operator-controller-manager-864dd78c4c-ljwdt\" (UID: \"143d070c-85fb-4315-82c1-ef2829ae24ab\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" Jun 08 19:44:58.245818 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.245781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c77jj\" (UniqueName: \"kubernetes.io/projected/143d070c-85fb-4315-82c1-ef2829ae24ab-kube-api-access-c77jj\") pod \"dns-operator-controller-manager-864dd78c4c-ljwdt\" (UID: \"143d070c-85fb-4315-82c1-ef2829ae24ab\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" Jun 08 19:44:58.347496 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.347461 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" Jun 08 19:44:58.481108 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.481082 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt"] Jun 08 19:44:58.483851 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:44:58.483820 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143d070c_85fb_4315_82c1_ef2829ae24ab.slice/crio-2c9f369220f66bea591707e4094cef34000685331ab4fd8588620ea89e2415ff WatchSource:0}: Error finding container 2c9f369220f66bea591707e4094cef34000685331ab4fd8588620ea89e2415ff: Status 404 returned error can't find the container with id 2c9f369220f66bea591707e4094cef34000685331ab4fd8588620ea89e2415ff Jun 08 19:44:58.613898 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:44:58.613806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" event={"ID":"143d070c-85fb-4315-82c1-ef2829ae24ab","Type":"ContainerStarted","Data":"2c9f369220f66bea591707e4094cef34000685331ab4fd8588620ea89e2415ff"} Jun 08 19:45:01.629091 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:01.629055 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" event={"ID":"143d070c-85fb-4315-82c1-ef2829ae24ab","Type":"ContainerStarted","Data":"73c2362820ba554299cbab42bd9ced819e3d8707aa05a5aed882366ff6c2f681"} Jun 08 19:45:01.629653 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:01.629169 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" Jun 08 19:45:01.649845 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:01.649792 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" podStartSLOduration=1.567489678 podStartE2EDuration="3.649770585s" totalImagesPullingTime="2.082280907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:01.648106383 +0000 UTC m=+688.203126849" watchObservedRunningTime="2026-06-08 19:45:01.649770585 +0000 UTC m=+688.204791051" Jun 08 19:45:01.993150 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:01.993071 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs"] Jun 08 19:45:01.995528 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:01.995508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" Jun 08 19:45:01.999974 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:01.999957 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jbhnh\"" Jun 08 19:45:02.012583 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:02.012555 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs"] Jun 08 19:45:02.068915 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:02.068878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps5dq\" (UniqueName: \"kubernetes.io/projected/4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa-kube-api-access-ps5dq\") pod \"authorino-operator-75cc8d5cb7-gn5xs\" (UID: \"4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" Jun 08 19:45:02.170042 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:02.170004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5dq\" (UniqueName: \"kubernetes.io/projected/4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa-kube-api-access-ps5dq\") pod \"authorino-operator-75cc8d5cb7-gn5xs\" (UID: \"4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" Jun 08 19:45:02.178472 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:02.178445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps5dq\" (UniqueName: \"kubernetes.io/projected/4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa-kube-api-access-ps5dq\") pod \"authorino-operator-75cc8d5cb7-gn5xs\" (UID: \"4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" Jun 08 19:45:02.306494 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:02.306398 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" Jun 08 19:45:02.440324 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:02.440298 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs"] Jun 08 19:45:02.442904 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:45:02.442881 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5f5d2d_3c2d_4d8b_b91b_2ff4f9455ffa.slice/crio-2c61f4a9f1a4cc8ac3e2aef9b07696f541acd22f4b9fb80c06cba9a770f7e149 WatchSource:0}: Error finding container 2c61f4a9f1a4cc8ac3e2aef9b07696f541acd22f4b9fb80c06cba9a770f7e149: Status 404 returned error can't find the container with id 2c61f4a9f1a4cc8ac3e2aef9b07696f541acd22f4b9fb80c06cba9a770f7e149 Jun 08 19:45:02.635200 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:02.635158 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" event={"ID":"4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa","Type":"ContainerStarted","Data":"2c61f4a9f1a4cc8ac3e2aef9b07696f541acd22f4b9fb80c06cba9a770f7e149"} Jun 08 19:45:05.652609 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:05.652572 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" event={"ID":"4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa","Type":"ContainerStarted","Data":"246ba061a86d6803a6772247a52ac778f42037fdfeb139cb7e111925f05f3d09"} Jun 08 19:45:05.653088 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:05.652679 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" Jun 08 19:45:05.689311 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:05.689249 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" podStartSLOduration=2.468701491 podStartE2EDuration="4.689231199s" totalImagesPullingTime="2.220529708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:05.687511594 +0000 UTC m=+692.242532084" watchObservedRunningTime="2026-06-08 19:45:05.689231199 +0000 UTC m=+692.244251670" Jun 08 19:45:08.616187 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:08.616158 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:45:12.637956 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:12.637927 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ljwdt" Jun 08 19:45:16.659718 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:16.659640 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gn5xs" Jun 08 19:45:28.634034 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.634000 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2"] Jun 08 19:45:28.634487 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.634208 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" podUID="e0a80629-a229-473e-b4e9-394dd70a5fe1" containerName="manager" containerID="cri-o://0e9d2797a1f3411336c2132f40edaa481218dcb54e112bb61db9e98b4d15baef" gracePeriod=2 Jun 08 19:45:28.658658 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:45:28.658600 2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e0a80629-a229-473e-b4e9-394dd70a5fe1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-9zlz2\": pods \"limitador-operator-controller-manager-859d7b78bd-9zlz2\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:45:28.660095 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.660065 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2"] Jun 08 19:45:28.671689 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.671660 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv"] Jun 08 19:45:28.672028 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.672015 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a80629-a229-473e-b4e9-394dd70a5fe1" containerName="manager" Jun 08 19:45:28.672073 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.672030 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a80629-a229-473e-b4e9-394dd70a5fe1" containerName="manager" Jun 08 19:45:28.672111 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.672099 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a80629-a229-473e-b4e9-394dd70a5fe1" containerName="manager" Jun 08 19:45:28.675025 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.675007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" Jun 08 19:45:28.697096 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.697061 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv"] Jun 08 19:45:28.715604 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:45:28.715567 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9zlz2\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="e0a80629-a229-473e-b4e9-394dd70a5fe1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:45:28.763148 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.763112 2562 generic.go:356] "Generic (PLEG): container finished" podID="e0a80629-a229-473e-b4e9-394dd70a5fe1" containerID="0e9d2797a1f3411336c2132f40edaa481218dcb54e112bb61db9e98b4d15baef" exitCode=0 Jun 08 19:45:28.810095 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.810059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6dl5\" (UniqueName: \"kubernetes.io/projected/7480d29c-e93c-48b7-b53d-4c652ad4d3d9-kube-api-access-q6dl5\") pod \"limitador-operator-controller-manager-859d7b78bd-7zswv\" (UID: \"7480d29c-e93c-48b7-b53d-4c652ad4d3d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" Jun 08 19:45:28.874419 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.874393 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:45:28.877781 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:45:28.877755 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9zlz2\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="e0a80629-a229-473e-b4e9-394dd70a5fe1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:45:28.911029 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.910948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6dl5\" (UniqueName: \"kubernetes.io/projected/7480d29c-e93c-48b7-b53d-4c652ad4d3d9-kube-api-access-q6dl5\") pod \"limitador-operator-controller-manager-859d7b78bd-7zswv\" (UID: \"7480d29c-e93c-48b7-b53d-4c652ad4d3d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" Jun 08 19:45:28.922750 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:28.922721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6dl5\" (UniqueName: \"kubernetes.io/projected/7480d29c-e93c-48b7-b53d-4c652ad4d3d9-kube-api-access-q6dl5\") pod \"limitador-operator-controller-manager-859d7b78bd-7zswv\" (UID: \"7480d29c-e93c-48b7-b53d-4c652ad4d3d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" Jun 08 19:45:29.008331 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.008291 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" Jun 08 19:45:29.011371 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.011263 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c5zj\" (UniqueName: \"kubernetes.io/projected/e0a80629-a229-473e-b4e9-394dd70a5fe1-kube-api-access-6c5zj\") pod \"e0a80629-a229-473e-b4e9-394dd70a5fe1\" (UID: \"e0a80629-a229-473e-b4e9-394dd70a5fe1\") " Jun 08 19:45:29.013312 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.013281 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a80629-a229-473e-b4e9-394dd70a5fe1-kube-api-access-6c5zj" (OuterVolumeSpecName: "kube-api-access-6c5zj") pod "e0a80629-a229-473e-b4e9-394dd70a5fe1" (UID: "e0a80629-a229-473e-b4e9-394dd70a5fe1"). InnerVolumeSpecName "kube-api-access-6c5zj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 19:45:29.112918 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.112885 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c5zj\" (UniqueName: \"kubernetes.io/projected/e0a80629-a229-473e-b4e9-394dd70a5fe1-kube-api-access-6c5zj\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\"" Jun 08 19:45:29.148970 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.148897 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv"] Jun 08 19:45:29.151307 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:45:29.151278 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7480d29c_e93c_48b7_b53d_4c652ad4d3d9.slice/crio-f0d60b2d6a9b6c2e548deb7e7ebe736284f0431b28ab5be2c36e121d6b85fe89 WatchSource:0}: Error finding container f0d60b2d6a9b6c2e548deb7e7ebe736284f0431b28ab5be2c36e121d6b85fe89: Status 404 returned error can't find the container with id f0d60b2d6a9b6c2e548deb7e7ebe736284f0431b28ab5be2c36e121d6b85fe89 Jun 08 19:45:29.770885 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.770849 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" event={"ID":"7480d29c-e93c-48b7-b53d-4c652ad4d3d9","Type":"ContainerStarted","Data":"7c4b579466aab6d67192bca03c6ef75aa3a3d4946ac818a39a21956f6edd45f2"} Jun 08 19:45:29.771375 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.770897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" event={"ID":"7480d29c-e93c-48b7-b53d-4c652ad4d3d9","Type":"ContainerStarted","Data":"f0d60b2d6a9b6c2e548deb7e7ebe736284f0431b28ab5be2c36e121d6b85fe89"} Jun 08 19:45:29.771375 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.770925 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" Jun 08 19:45:29.772234 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.772217 2562 scope.go:117] "RemoveContainer" containerID="0e9d2797a1f3411336c2132f40edaa481218dcb54e112bb61db9e98b4d15baef" Jun 08 19:45:29.772234 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.772225 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:45:29.792221 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.792172 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" podStartSLOduration=1.792155551 podStartE2EDuration="1.792155551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:29.790787699 +0000 UTC m=+716.345808186" watchObservedRunningTime="2026-06-08 19:45:29.792155551 +0000 UTC m=+716.347176016" Jun 08 19:45:29.793414 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:45:29.793383 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9zlz2\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="e0a80629-a229-473e-b4e9-394dd70a5fe1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:45:29.797401 ip-10-0-133-234 kubenswrapper[2562]: E0608 19:45:29.797368 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9zlz2\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="e0a80629-a229-473e-b4e9-394dd70a5fe1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9zlz2" Jun 08 19:45:29.921010 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:29.920972 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0a80629-a229-473e-b4e9-394dd70a5fe1" path="/var/lib/kubelet/pods/e0a80629-a229-473e-b4e9-394dd70a5fe1/volumes" Jun 08 19:45:40.780227 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:40.780196 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7zswv" Jun 08 19:45:59.003661 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.003628 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf"] Jun 08 19:45:59.006023 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.006007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.043665 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.043636 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-t25wj\"" Jun 08 19:45:59.093831 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.093793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91c8e435-cbea-4786-af59-c786089e2408-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.093831 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.093834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91c8e435-cbea-4786-af59-c786089e2408-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.094046 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.093863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.094046 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.093941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.094046 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.093976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.094143 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.094051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm9rd\" (UniqueName: \"kubernetes.io/projected/91c8e435-cbea-4786-af59-c786089e2408-kube-api-access-pm9rd\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.094143 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.094079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.094143 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.094110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91c8e435-cbea-4786-af59-c786089e2408-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.094143 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.094136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.194821 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.194731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm9rd\" (UniqueName: \"kubernetes.io/projected/91c8e435-cbea-4786-af59-c786089e2408-kube-api-access-pm9rd\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.194821 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.194782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195018 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.194900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91c8e435-cbea-4786-af59-c786089e2408-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195018 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.194947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195018 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91c8e435-cbea-4786-af59-c786089e2408-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195171 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91c8e435-cbea-4786-af59-c786089e2408-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195171 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195171 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195171 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195368 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195356 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195520 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195492 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195653 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195752 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195693 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91c8e435-cbea-4786-af59-c786089e2408-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.195807 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.195783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.197538 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.197511 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91c8e435-cbea-4786-af59-c786089e2408-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.197686 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.197668 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91c8e435-cbea-4786-af59-c786089e2408-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.216263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.216230 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf"] Jun 08 19:45:59.227761 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.227724 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91c8e435-cbea-4786-af59-c786089e2408-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.232999 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.232977 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm9rd\" (UniqueName: \"kubernetes.io/projected/91c8e435-cbea-4786-af59-c786089e2408-kube-api-access-pm9rd\") pod \"maas-default-gateway-openshift-default-687ff6996-tk9vf\" (UID: \"91c8e435-cbea-4786-af59-c786089e2408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.315994 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.315954 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:45:59.477807 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.477781 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf"] Jun 08 19:45:59.479697 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:45:59.479672 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c8e435_cbea_4786_af59_c786089e2408.slice/crio-7bd98ac2d59db7826ed10c37d9ace1e8e2e17fb415cf091542ec52fd58c2cd28 WatchSource:0}: Error finding container 7bd98ac2d59db7826ed10c37d9ace1e8e2e17fb415cf091542ec52fd58c2cd28: Status 404 returned error can't find the container with id 7bd98ac2d59db7826ed10c37d9ace1e8e2e17fb415cf091542ec52fd58c2cd28 Jun 08 19:45:59.481695 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.481666 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:45:59.481760 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.481732 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:45:59.481796 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.481762 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:45:59.913917 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.913879 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" event={"ID":"91c8e435-cbea-4786-af59-c786089e2408","Type":"ContainerStarted","Data":"67209c46dfdaba3c316b7b810d83f9e657b11a292131b10be88b5b4317b38fa7"} Jun 08 19:45:59.914124 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.913948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" event={"ID":"91c8e435-cbea-4786-af59-c786089e2408","Type":"ContainerStarted","Data":"7bd98ac2d59db7826ed10c37d9ace1e8e2e17fb415cf091542ec52fd58c2cd28"} Jun 08 19:45:59.948122 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:45:59.948073 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" podStartSLOduration=1.948056839 podStartE2EDuration="1.948056839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:45:59.946584967 +0000 UTC m=+746.501605445" watchObservedRunningTime="2026-06-08 19:45:59.948056839 +0000 UTC m=+746.503077305" Jun 08 19:46:00.316381 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:00.316296 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:46:00.320777 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:00.320753 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:46:00.918145 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:00.918113 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:46:00.919051 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:00.919019 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:46:04.057381 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.057337 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:46:04.060664 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.060642 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:46:04.067265 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.067237 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 19:46:04.067457 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.067313 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f7k5b\"" Jun 08 19:46:04.075573 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.075541 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:46:04.107777 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.107744 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:46:04.144222 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.144183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/787d8197-826c-4ff7-800d-a5d7e61219f0-config-file\") pod \"limitador-limitador-54d6d988d5-vp5cz\" (UID: \"787d8197-826c-4ff7-800d-a5d7e61219f0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:46:04.144397 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.144276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p89hw\" (UniqueName: \"kubernetes.io/projected/787d8197-826c-4ff7-800d-a5d7e61219f0-kube-api-access-p89hw\") pod \"limitador-limitador-54d6d988d5-vp5cz\" (UID: \"787d8197-826c-4ff7-800d-a5d7e61219f0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:46:04.245066 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.245027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p89hw\" (UniqueName: \"kubernetes.io/projected/787d8197-826c-4ff7-800d-a5d7e61219f0-kube-api-access-p89hw\") pod \"limitador-limitador-54d6d988d5-vp5cz\" (UID: \"787d8197-826c-4ff7-800d-a5d7e61219f0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:46:04.245263 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.245089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/787d8197-826c-4ff7-800d-a5d7e61219f0-config-file\") pod \"limitador-limitador-54d6d988d5-vp5cz\" (UID: \"787d8197-826c-4ff7-800d-a5d7e61219f0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:46:04.245872 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.245852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/787d8197-826c-4ff7-800d-a5d7e61219f0-config-file\") pod \"limitador-limitador-54d6d988d5-vp5cz\" (UID: \"787d8197-826c-4ff7-800d-a5d7e61219f0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:46:04.256471 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.256443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p89hw\" (UniqueName: \"kubernetes.io/projected/787d8197-826c-4ff7-800d-a5d7e61219f0-kube-api-access-p89hw\") pod \"limitador-limitador-54d6d988d5-vp5cz\" (UID: \"787d8197-826c-4ff7-800d-a5d7e61219f0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:46:04.372639 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.372608 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:46:04.508957 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.508759 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:46:04.511796 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:46:04.511765 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787d8197_826c_4ff7_800d_a5d7e61219f0.slice/crio-05575ae1b00a27269586766da73465cfbabe07c294a845b58b937b5396a411ba WatchSource:0}: Error finding container 05575ae1b00a27269586766da73465cfbabe07c294a845b58b937b5396a411ba: Status 404 returned error can't find the container with id 05575ae1b00a27269586766da73465cfbabe07c294a845b58b937b5396a411ba Jun 08 19:46:04.941545 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:04.941502 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" event={"ID":"787d8197-826c-4ff7-800d-a5d7e61219f0","Type":"ContainerStarted","Data":"05575ae1b00a27269586766da73465cfbabe07c294a845b58b937b5396a411ba"} Jun 08 19:46:07.958497 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:07.958464 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" event={"ID":"787d8197-826c-4ff7-800d-a5d7e61219f0","Type":"ContainerStarted","Data":"5cef69b4363524f4507412bcf5a655668aa7a97bd0bcf1f684bb9fd08a417016"} Jun 08 19:46:07.958952 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:07.958614 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:46:07.977771 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:07.977725 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" podStartSLOduration=1.5814380300000002 podStartE2EDuration="3.977710728s" totalImagesPullingTime="2.396272698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:46:07.976086446 +0000 UTC m=+754.531106913" watchObservedRunningTime="2026-06-08 19:46:07.977710728 +0000 UTC m=+754.532731193" Jun 08 19:46:18.963842 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:46:18.963807 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vp5cz" Jun 08 19:48:14.146286 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.146247 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-d79d8c5d-sxzvd"] Jun 08 19:48:14.148691 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.148673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:14.152243 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.152222 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 19:48:14.153409 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.153384 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6tp2h\"" Jun 08 19:48:14.168708 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.168678 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d79d8c5d-sxzvd"] Jun 08 19:48:14.231511 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.231485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c17a3616-f43e-4dc0-8cc4-cc8f607861c2-maas-api-tls\") pod \"maas-api-d79d8c5d-sxzvd\" (UID: \"c17a3616-f43e-4dc0-8cc4-cc8f607861c2\") " pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:14.231588 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.231548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkfdh\" (UniqueName: \"kubernetes.io/projected/c17a3616-f43e-4dc0-8cc4-cc8f607861c2-kube-api-access-mkfdh\") pod \"maas-api-d79d8c5d-sxzvd\" (UID: \"c17a3616-f43e-4dc0-8cc4-cc8f607861c2\") " pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:14.332942 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.332901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c17a3616-f43e-4dc0-8cc4-cc8f607861c2-maas-api-tls\") pod \"maas-api-d79d8c5d-sxzvd\" (UID: \"c17a3616-f43e-4dc0-8cc4-cc8f607861c2\") " pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:14.333130 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.332956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkfdh\" (UniqueName: \"kubernetes.io/projected/c17a3616-f43e-4dc0-8cc4-cc8f607861c2-kube-api-access-mkfdh\") pod \"maas-api-d79d8c5d-sxzvd\" (UID: \"c17a3616-f43e-4dc0-8cc4-cc8f607861c2\") " pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:14.335409 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.335388 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c17a3616-f43e-4dc0-8cc4-cc8f607861c2-maas-api-tls\") pod \"maas-api-d79d8c5d-sxzvd\" (UID: \"c17a3616-f43e-4dc0-8cc4-cc8f607861c2\") " pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:14.341656 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.341632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkfdh\" (UniqueName: \"kubernetes.io/projected/c17a3616-f43e-4dc0-8cc4-cc8f607861c2-kube-api-access-mkfdh\") pod \"maas-api-d79d8c5d-sxzvd\" (UID: \"c17a3616-f43e-4dc0-8cc4-cc8f607861c2\") " pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:14.484103 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.484009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:14.629715 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.629687 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d79d8c5d-sxzvd"] Jun 08 19:48:14.631290 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:48:14.631265 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc17a3616_f43e_4dc0_8cc4_cc8f607861c2.slice/crio-601454a4aaee7ff3c6d3a4cb83bc77d1074a8c1e86796f3e664face7ba3956ee WatchSource:0}: Error finding container 601454a4aaee7ff3c6d3a4cb83bc77d1074a8c1e86796f3e664face7ba3956ee: Status 404 returned error can't find the container with id 601454a4aaee7ff3c6d3a4cb83bc77d1074a8c1e86796f3e664face7ba3956ee Jun 08 19:48:14.767249 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:14.767161 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:48:15.565918 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:15.565824 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d79d8c5d-sxzvd" event={"ID":"c17a3616-f43e-4dc0-8cc4-cc8f607861c2","Type":"ContainerStarted","Data":"601454a4aaee7ff3c6d3a4cb83bc77d1074a8c1e86796f3e664face7ba3956ee"} Jun 08 19:48:17.584888 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:17.584840 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d79d8c5d-sxzvd" event={"ID":"c17a3616-f43e-4dc0-8cc4-cc8f607861c2","Type":"ContainerStarted","Data":"65b08858cf71b1492a1dddb31cf2f7a6e9dff65e466b9fd469a613b21ca12ead"} Jun 08 19:48:17.585287 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:17.584953 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:17.601967 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:17.601919 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-d79d8c5d-sxzvd" podStartSLOduration=0.757662023 podStartE2EDuration="3.601903169s" totalImagesPullingTime="2.844241146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:48:17.600957889 +0000 UTC m=+884.155978379" watchObservedRunningTime="2026-06-08 19:48:17.601903169 +0000 UTC m=+884.156923634" Jun 08 19:48:22.613293 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:22.613253 2562 generic.go:356] "Generic (PLEG): container finished" podID="91c8e435-cbea-4786-af59-c786089e2408" containerID="67209c46dfdaba3c316b7b810d83f9e657b11a292131b10be88b5b4317b38fa7" exitCode=0 Jun 08 19:48:22.613734 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:22.613327 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" event={"ID":"91c8e435-cbea-4786-af59-c786089e2408","Type":"ContainerDied","Data":"67209c46dfdaba3c316b7b810d83f9e657b11a292131b10be88b5b4317b38fa7"} Jun 08 19:48:22.613798 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:22.613783 2562 scope.go:117] "RemoveContainer" containerID="67209c46dfdaba3c316b7b810d83f9e657b11a292131b10be88b5b4317b38fa7" Jun 08 19:48:22.614750 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:22.614724 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:48:22.614848 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:22.614801 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:48:22.614908 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:22.614849 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 19:48:23.595188 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:23.595156 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-d79d8c5d-sxzvd" Jun 08 19:48:23.620508 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:23.620472 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" event={"ID":"91c8e435-cbea-4786-af59-c786089e2408","Type":"ContainerStarted","Data":"5814b1274e509d5a99df68c6ecf55e308f351d1dcf480767c868e99d702c13d6"} Jun 08 19:48:24.317028 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:24.316979 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:48:24.317269 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:24.317245 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-tk9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jun 08 19:48:24.317321 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:24.317299 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" podUID="91c8e435-cbea-4786-af59-c786089e2408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jun 08 19:48:25.317043 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:25.317007 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-tk9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jun 08 19:48:25.317470 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:25.317066 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" podUID="91c8e435-cbea-4786-af59-c786089e2408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jun 08 19:48:26.316582 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:26.316541 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-tk9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jun 08 19:48:26.316763 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:26.316602 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" podUID="91c8e435-cbea-4786-af59-c786089e2408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jun 08 19:48:27.317335 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:27.317296 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-tk9vf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jun 08 19:48:27.317834 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:27.317360 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" podUID="91c8e435-cbea-4786-af59-c786089e2408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jun 08 19:48:28.320329 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:28.320298 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:48:28.320756 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:28.320594 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:48:28.321190 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:28.321171 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tk9vf" Jun 08 19:48:33.933736 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:33.933702 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:48:33.939518 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:33.939494 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:48:33.939679 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:33.939560 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:48:33.945558 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:48:33.945535 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wkpqb_9da1f431-17eb-41ab-8ecb-8da7f49ee78a/ovn-acl-logging/0.log" Jun 08 19:49:22.174309 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.174269 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g"] Jun 08 19:49:22.178168 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.178141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.180623 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.180595 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mfvng\"" Jun 08 19:49:22.181947 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.181910 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 19:49:22.181947 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.181910 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 19:49:22.182146 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.182047 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 19:49:22.187388 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.187359 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g"] Jun 08 19:49:22.276261 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.276208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.276494 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.276329 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.276494 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.276379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98201bee-a87c-46ed-9af0-968814391850-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.276494 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.276411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.276494 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.276467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.276659 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.276502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smk5g\" (UniqueName: \"kubernetes.io/projected/98201bee-a87c-46ed-9af0-968814391850-kube-api-access-smk5g\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.377528 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.377482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.377528 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.377527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98201bee-a87c-46ed-9af0-968814391850-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.377836 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.377643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.377836 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.377689 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.377836 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.377722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smk5g\" (UniqueName: \"kubernetes.io/projected/98201bee-a87c-46ed-9af0-968814391850-kube-api-access-smk5g\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.377836 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.377778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.378070 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.378046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.378121 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.378098 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.378157 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.378124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.379813 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.379792 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98201bee-a87c-46ed-9af0-968814391850-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.380209 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.380188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98201bee-a87c-46ed-9af0-968814391850-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.385376 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.385353 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smk5g\" (UniqueName: \"kubernetes.io/projected/98201bee-a87c-46ed-9af0-968814391850-kube-api-access-smk5g\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g\" (UID: \"98201bee-a87c-46ed-9af0-968814391850\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.477181 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.477093 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:49:22.489411 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.489379 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:22.628119 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.628093 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g"] Jun 08 19:49:22.629385 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:49:22.629360 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98201bee_a87c_46ed_9af0_968814391850.slice/crio-be907e5860a052abc34047e401eb97489bdb73fc3725adb00a66cee840ac6e88 WatchSource:0}: Error finding container be907e5860a052abc34047e401eb97489bdb73fc3725adb00a66cee840ac6e88: Status 404 returned error can't find the container with id be907e5860a052abc34047e401eb97489bdb73fc3725adb00a66cee840ac6e88 Jun 08 19:49:22.910799 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:22.910763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" event={"ID":"98201bee-a87c-46ed-9af0-968814391850","Type":"ContainerStarted","Data":"be907e5860a052abc34047e401eb97489bdb73fc3725adb00a66cee840ac6e88"} Jun 08 19:49:26.933371 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:26.933334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" event={"ID":"98201bee-a87c-46ed-9af0-968814391850","Type":"ContainerStarted","Data":"905f7c9dea52ae112e0795aaacb70a3fae480415f0a6b56b1affe1b76109411d"} Jun 08 19:49:28.943729 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:28.943694 2562 generic.go:356] "Generic (PLEG): container finished" podID="98201bee-a87c-46ed-9af0-968814391850" containerID="905f7c9dea52ae112e0795aaacb70a3fae480415f0a6b56b1affe1b76109411d" exitCode=0 Jun 08 19:49:28.944118 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:28.943761 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" event={"ID":"98201bee-a87c-46ed-9af0-968814391850","Type":"ContainerDied","Data":"905f7c9dea52ae112e0795aaacb70a3fae480415f0a6b56b1affe1b76109411d"} Jun 08 19:49:30.955219 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:30.955180 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" event={"ID":"98201bee-a87c-46ed-9af0-968814391850","Type":"ContainerStarted","Data":"1ef75b0fd4a4cd169db9308ba94eeda39afa2a84e039bbf724a2b18ef6551a85"} Jun 08 19:49:30.975083 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:30.975030 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" podStartSLOduration=2.334734622 podStartE2EDuration="8.975014228s" totalImagesPullingTime="5.387475463s" totalInitContainerRuntime="1.252804143s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:49:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:49:30.974353144 +0000 UTC m=+957.529373640" watchObservedRunningTime="2026-06-08 19:49:30.975014228 +0000 UTC m=+957.530034728" Jun 08 19:49:32.490548 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:32.490506 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:32.490980 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:32.490576 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:32.503455 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:32.503403 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:32.975994 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:32.975964 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g" Jun 08 19:49:43.553331 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.553294 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll"] Jun 08 19:49:43.569799 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.569762 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll"] Jun 08 19:49:43.569961 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.569879 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.572348 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.572320 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 19:49:43.684798 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.684749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abdd8231-8ef4-446b-ba62-0a2c610de829-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.684798 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.684804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.685032 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.684868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpqcs\" (UniqueName: \"kubernetes.io/projected/abdd8231-8ef4-446b-ba62-0a2c610de829-kube-api-access-vpqcs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.685032 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.684920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.685032 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.684951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.685159 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.685059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.786067 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.786027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.786237 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.786082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abdd8231-8ef4-446b-ba62-0a2c610de829-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.786237 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.786101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.786237 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.786223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqcs\" (UniqueName: \"kubernetes.io/projected/abdd8231-8ef4-446b-ba62-0a2c610de829-kube-api-access-vpqcs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.786388 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.786280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.786388 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.786303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.786666 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.786638 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.786783 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.786643 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.786783 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.786680 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.788351 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.788324 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abdd8231-8ef4-446b-ba62-0a2c610de829-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.788856 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.788834 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abdd8231-8ef4-446b-ba62-0a2c610de829-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.794128 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.794102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpqcs\" (UniqueName: \"kubernetes.io/projected/abdd8231-8ef4-446b-ba62-0a2c610de829-kube-api-access-vpqcs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2grll\" (UID: \"abdd8231-8ef4-446b-ba62-0a2c610de829\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:43.880392 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:43.880350 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:44.016798 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:44.016762 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll"] Jun 08 19:49:44.018077 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:49:44.018052 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabdd8231_8ef4_446b_ba62_0a2c610de829.slice/crio-81193d82973d43472f11a9e4e60d4b137cdbf2262c45afb2bc72c8b61f3776ec WatchSource:0}: Error finding container 81193d82973d43472f11a9e4e60d4b137cdbf2262c45afb2bc72c8b61f3776ec: Status 404 returned error can't find the container with id 81193d82973d43472f11a9e4e60d4b137cdbf2262c45afb2bc72c8b61f3776ec Jun 08 19:49:44.070815 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:44.070793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:49:45.025944 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:45.025858 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" event={"ID":"abdd8231-8ef4-446b-ba62-0a2c610de829","Type":"ContainerStarted","Data":"3b51dd276e250c2d9584f6614ffa8e17546456469ebe5e2ecd2a317bc7a56fd2"} Jun 08 19:49:45.025944 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:45.025925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" event={"ID":"abdd8231-8ef4-446b-ba62-0a2c610de829","Type":"ContainerStarted","Data":"81193d82973d43472f11a9e4e60d4b137cdbf2262c45afb2bc72c8b61f3776ec"} Jun 08 19:49:46.032951 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:46.032909 2562 generic.go:356] "Generic (PLEG): container finished" podID="abdd8231-8ef4-446b-ba62-0a2c610de829" containerID="3b51dd276e250c2d9584f6614ffa8e17546456469ebe5e2ecd2a317bc7a56fd2" exitCode=0 Jun 08 19:49:46.033377 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:46.032982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" event={"ID":"abdd8231-8ef4-446b-ba62-0a2c610de829","Type":"ContainerDied","Data":"3b51dd276e250c2d9584f6614ffa8e17546456469ebe5e2ecd2a317bc7a56fd2"} Jun 08 19:49:47.039788 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:47.039754 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" event={"ID":"abdd8231-8ef4-446b-ba62-0a2c610de829","Type":"ContainerStarted","Data":"4018c3e55da33a767a6bdb59bd6c626757461168543dadcbe4e90e8928ba0846"} Jun 08 19:49:47.060148 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:47.060094 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" podStartSLOduration=2.595247623 podStartE2EDuration="4.060079354s" totalImagesPullingTime="209.356396ms" totalInitContainerRuntime="1.255475335s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:49:47.058340228 +0000 UTC m=+973.613360721" watchObservedRunningTime="2026-06-08 19:49:47.060079354 +0000 UTC m=+973.615099818" Jun 08 19:49:53.880896 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:53.880845 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:53.881577 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:53.880929 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:53.893658 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:53.893635 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:49:54.087581 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:49:54.087547 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2grll" Jun 08 19:50:06.761579 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.761534 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4"] Jun 08 19:50:06.764577 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.764553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:06.767170 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.767145 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 19:50:06.776315 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.776286 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4"] Jun 08 19:50:06.905651 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.905613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:06.905651 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.905651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:06.905870 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.905671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzgqb\" (UniqueName: \"kubernetes.io/projected/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-kube-api-access-lzgqb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:06.905870 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.905696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:06.905870 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.905774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:06.905870 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:06.905841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.006827 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.006789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.006827 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.006825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.007097 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.006845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzgqb\" (UniqueName: \"kubernetes.io/projected/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-kube-api-access-lzgqb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.007097 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.006866 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.007097 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.007046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.007097 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.007094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.007343 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.007316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.007442 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.007406 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.007508 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.007415 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.009331 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.009309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.009610 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.009591 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.015206 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.015145 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzgqb\" (UniqueName: \"kubernetes.io/projected/2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b-kube-api-access-lzgqb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4\" (UID: \"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.076354 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.076313 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:07.213318 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.213288 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4"] Jun 08 19:50:07.214717 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:50:07.214687 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c29e99e_b9e7_4c3b_a2c0_3ee5f340793b.slice/crio-8700c1aebae6131fe7c1bf00a56c86b9fd2ecab904de2c7d477c169b1e3ba4e8 WatchSource:0}: Error finding container 8700c1aebae6131fe7c1bf00a56c86b9fd2ecab904de2c7d477c169b1e3ba4e8: Status 404 returned error can't find the container with id 8700c1aebae6131fe7c1bf00a56c86b9fd2ecab904de2c7d477c169b1e3ba4e8 Jun 08 19:50:07.473180 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:07.473143 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:50:08.150449 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:08.150386 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" event={"ID":"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b","Type":"ContainerStarted","Data":"5bf4332b4d8e6978a07a0d06a816025948f7f6c09b2d746a817d9137a3dc9ef3"} Jun 08 19:50:08.150840 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:08.150469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" event={"ID":"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b","Type":"ContainerStarted","Data":"8700c1aebae6131fe7c1bf00a56c86b9fd2ecab904de2c7d477c169b1e3ba4e8"} Jun 08 19:50:29.774950 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:29.774910 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:50:36.286999 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:36.286965 2562 generic.go:356] "Generic (PLEG): container finished" podID="2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b" containerID="5bf4332b4d8e6978a07a0d06a816025948f7f6c09b2d746a817d9137a3dc9ef3" exitCode=0 Jun 08 19:50:36.287382 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:36.287037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" event={"ID":"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b","Type":"ContainerDied","Data":"5bf4332b4d8e6978a07a0d06a816025948f7f6c09b2d746a817d9137a3dc9ef3"} Jun 08 19:50:36.287736 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:36.287720 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 19:50:37.293655 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:37.293615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" event={"ID":"2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b","Type":"ContainerStarted","Data":"286875a750519a5a5ed7cd00499bb02279f4740fa927513d8c0eb858032bddfd"} Jun 08 19:50:37.315527 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:37.315478 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" podStartSLOduration=2.810708777 podStartE2EDuration="31.315460014s" totalImagesPullingTime="185.685727ms" totalInitContainerRuntime="28.31906551s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:50:37.313558651 +0000 UTC m=+1023.868579117" watchObservedRunningTime="2026-06-08 19:50:37.315460014 +0000 UTC m=+1023.870480480" Jun 08 19:50:47.076496 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:47.076459 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:47.077002 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:47.076523 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:47.089259 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:47.089230 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:47.354879 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:47.354795 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4" Jun 08 19:50:48.881319 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:48.881288 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9"] Jun 08 19:50:48.885283 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:48.885263 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:48.887774 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:48.887754 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 19:50:48.893773 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:48.893750 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9"] Jun 08 19:50:49.008359 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.008303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.008589 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.008387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.008589 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.008410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.008589 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.008476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edb08311-70a9-458b-b213-e25cb2c5700f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.008727 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.008603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.008727 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.008629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzzk2\" (UniqueName: \"kubernetes.io/projected/edb08311-70a9-458b-b213-e25cb2c5700f-kube-api-access-pzzk2\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.109091 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.109055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.109282 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.109129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edb08311-70a9-458b-b213-e25cb2c5700f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.109282 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.109156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.109282 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.109179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzzk2\" (UniqueName: \"kubernetes.io/projected/edb08311-70a9-458b-b213-e25cb2c5700f-kube-api-access-pzzk2\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.109282 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.109210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.109282 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.109267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.109586 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.109546 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.109654 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.109631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.109718 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.109703 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.111255 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.111236 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edb08311-70a9-458b-b213-e25cb2c5700f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.111596 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.111577 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edb08311-70a9-458b-b213-e25cb2c5700f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.117488 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.117468 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzzk2\" (UniqueName: \"kubernetes.io/projected/edb08311-70a9-458b-b213-e25cb2c5700f-kube-api-access-pzzk2\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-trrg9\" (UID: \"edb08311-70a9-458b-b213-e25cb2c5700f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.196382 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.196288 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:49.330231 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.330205 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9"] Jun 08 19:50:49.331687 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:50:49.331660 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb08311_70a9_458b_b213_e25cb2c5700f.slice/crio-5b1707332ac0c254b0d8de67b213277809fb3a3439e33a2a0eba627fecd32b1c WatchSource:0}: Error finding container 5b1707332ac0c254b0d8de67b213277809fb3a3439e33a2a0eba627fecd32b1c: Status 404 returned error can't find the container with id 5b1707332ac0c254b0d8de67b213277809fb3a3439e33a2a0eba627fecd32b1c Jun 08 19:50:49.354401 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.354374 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" event={"ID":"edb08311-70a9-458b-b213-e25cb2c5700f","Type":"ContainerStarted","Data":"5b1707332ac0c254b0d8de67b213277809fb3a3439e33a2a0eba627fecd32b1c"} Jun 08 19:50:49.584299 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:49.584260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:50:50.360276 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:50.360238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" event={"ID":"edb08311-70a9-458b-b213-e25cb2c5700f","Type":"ContainerStarted","Data":"98a248dfc6106772469f9832898b72e3efabe38923cd15372b0ec9d59a664009"} Jun 08 19:50:51.366259 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:51.366219 2562 generic.go:356] "Generic (PLEG): container finished" podID="edb08311-70a9-458b-b213-e25cb2c5700f" containerID="98a248dfc6106772469f9832898b72e3efabe38923cd15372b0ec9d59a664009" exitCode=0 Jun 08 19:50:51.366654 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:51.366311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" event={"ID":"edb08311-70a9-458b-b213-e25cb2c5700f","Type":"ContainerDied","Data":"98a248dfc6106772469f9832898b72e3efabe38923cd15372b0ec9d59a664009"} Jun 08 19:50:52.378366 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:52.378330 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" event={"ID":"edb08311-70a9-458b-b213-e25cb2c5700f","Type":"ContainerStarted","Data":"6801e6a899f19706d8767e9dc6a48d82d1213c1ae17ac4abb7a5eb678dd55c47"} Jun 08 19:50:52.398174 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:52.398123 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" podStartSLOduration=2.801769584 podStartE2EDuration="4.398108092s" totalImagesPullingTime="192.127294ms" totalInitContainerRuntime="1.404211214s" isStatefulPod=false podCreationTimestamp="2026-06-08 19:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:50:52.395894812 +0000 UTC m=+1038.950915296" watchObservedRunningTime="2026-06-08 19:50:52.398108092 +0000 UTC m=+1038.953128558" Jun 08 19:50:59.197314 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:59.197271 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:59.197769 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:59.197362 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:59.210007 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:59.209978 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:50:59.427464 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:50:59.427424 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-trrg9" Jun 08 19:51:05.868572 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:51:05.868532 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vp5cz"] Jun 08 19:52:42.746635 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:42.746605 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7b9bfd4b8b-zkvn5_8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9/nginx/0.log" Jun 08 19:52:43.091518 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:43.091491 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d79d8c5d-sxzvd_c17a3616-f43e-4dc0-8cc4-cc8f607861c2/maas-api/0.log" Jun 08 19:52:43.831627 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:43.831594 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b897fbc-wl2zb_24a9e964-18be-47c1-8d33-fef00907ca5c/manager/0.log" Jun 08 19:52:43.842041 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:43.842020 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b897fbc-wl2zb_24a9e964-18be-47c1-8d33-fef00907ca5c/copy-manifests/0.log" Jun 08 19:52:45.416419 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:45.416330 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gn5xs_4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa/manager/0.log" Jun 08 19:52:45.523852 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:45.523823 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ljwdt_143d070c-85fb-4315-82c1-ef2829ae24ab/manager/0.log" Jun 08 19:52:45.780891 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:45.780816 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5q2xt_f2fb16e6-72a6-4006-a746-09b636a1c1ed/registry-server/0.log" Jun 08 19:52:46.033726 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:46.033641 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vp5cz_787d8197-826c-4ff7-800d-a5d7e61219f0/limitador/0.log" Jun 08 19:52:46.148007 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:46.147977 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7zswv_7480d29c-e93c-48b7-b53d-4c652ad4d3d9/manager/0.log" Jun 08 19:52:46.490990 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:46.490958 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958qn76_1e6bb836-f6c4-4327-95e4-6603bc8eabb1/istio-proxy/0.log" Jun 08 19:52:46.931899 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:46.931871 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tk9vf_91c8e435-cbea-4786-af59-c786089e2408/istio-proxy/1.log" Jun 08 19:52:47.605273 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:47.605240 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g_98201bee-a87c-46ed-9af0-968814391850/main/0.log" Jun 08 19:52:47.616816 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:47.616794 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ncx8g_98201bee-a87c-46ed-9af0-968814391850/storage-initializer/0.log" Jun 08 19:52:47.732643 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:47.732614 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2grll_abdd8231-8ef4-446b-ba62-0a2c610de829/storage-initializer/0.log" Jun 08 19:52:47.746316 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:47.746279 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2grll_abdd8231-8ef4-446b-ba62-0a2c610de829/main/0.log" Jun 08 19:52:47.854767 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:47.854734 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4_2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b/storage-initializer/0.log" Jun 08 19:52:47.863119 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:47.863031 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-jzcs4_2c29e99e-b9e7-4c3b-a2c0-3ee5f340793b/main/0.log" Jun 08 19:52:48.093298 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:48.093270 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-trrg9_edb08311-70a9-458b-b213-e25cb2c5700f/storage-initializer/0.log" Jun 08 19:52:48.107956 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:48.107928 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-trrg9_edb08311-70a9-458b-b213-e25cb2c5700f/main/0.log" Jun 08 19:52:55.834213 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:55.834182 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zdflj_7e5fe73f-5e92-40f3-ac32-9300d24d5102/global-pull-secret-syncer/0.log" Jun 08 19:52:55.954036 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:55.954007 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h5k5x_11999dd3-1fdf-4bcf-92c3-93be6cf1218c/konnectivity-agent/0.log" Jun 08 19:52:56.008567 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:52:56.008536 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-234.ec2.internal_bc8eed032c0c452db97abed635e2c60c/haproxy/0.log" Jun 08 19:53:01.705402 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:01.705372 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gn5xs_4f5f5d2d-3c2d-4d8b-b91b-2ff4f9455ffa/manager/0.log" Jun 08 19:53:01.752862 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:01.752837 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ljwdt_143d070c-85fb-4315-82c1-ef2829ae24ab/manager/0.log" Jun 08 19:53:01.874592 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:01.874567 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5q2xt_f2fb16e6-72a6-4006-a746-09b636a1c1ed/registry-server/0.log" Jun 08 19:53:02.048286 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:02.048196 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vp5cz_787d8197-826c-4ff7-800d-a5d7e61219f0/limitador/0.log" Jun 08 19:53:02.099923 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:02.099892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7zswv_7480d29c-e93c-48b7-b53d-4c652ad4d3d9/manager/0.log" Jun 08 19:53:03.888167 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:03.888139 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85b6fd7e-aaa4-4918-a214-e5240a6cde80/alertmanager/0.log" Jun 08 19:53:03.999308 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:03.999279 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85b6fd7e-aaa4-4918-a214-e5240a6cde80/config-reloader/0.log" Jun 08 19:53:04.086787 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:04.086743 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85b6fd7e-aaa4-4918-a214-e5240a6cde80/kube-rbac-proxy-web/0.log" Jun 08 19:53:04.161941 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:04.161842 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85b6fd7e-aaa4-4918-a214-e5240a6cde80/kube-rbac-proxy/0.log" Jun 08 19:53:04.267100 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:04.267055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85b6fd7e-aaa4-4918-a214-e5240a6cde80/kube-rbac-proxy-metric/0.log" Jun 08 19:53:04.343205 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:04.343177 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85b6fd7e-aaa4-4918-a214-e5240a6cde80/prom-label-proxy/0.log" Jun 08 19:53:04.409110 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:04.409057 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85b6fd7e-aaa4-4918-a214-e5240a6cde80/init-config-reloader/0.log" Jun 08 19:53:04.879692 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:04.879661 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-lcnj6_df72b90b-fff9-471a-a0b7-92539cfb3a68/monitoring-plugin/0.log" Jun 08 19:53:04.935746 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:04.935661 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bflb7_b0f6faf1-11c3-4faf-82f2-7bebf34654e7/node-exporter/0.log" Jun 08 19:53:04.989065 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:04.989038 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bflb7_b0f6faf1-11c3-4faf-82f2-7bebf34654e7/kube-rbac-proxy/0.log" Jun 08 19:53:05.071687 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.071662 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bflb7_b0f6faf1-11c3-4faf-82f2-7bebf34654e7/init-textfile/0.log" Jun 08 19:53:05.717120 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.717094 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be55592c-b758-4267-b309-634b1644bafd/prometheus/0.log" Jun 08 19:53:05.787689 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.787663 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be55592c-b758-4267-b309-634b1644bafd/config-reloader/0.log" Jun 08 19:53:05.853587 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.853562 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be55592c-b758-4267-b309-634b1644bafd/thanos-sidecar/0.log" Jun 08 19:53:05.937630 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.937592 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4"] Jun 08 19:53:05.941568 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.941549 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:05.954615 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.954589 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wcfn\"/\"openshift-service-ca.crt\"" Jun 08 19:53:05.954763 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.954624 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wcfn\"/\"kube-root-ca.crt\"" Jun 08 19:53:05.954763 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.954625 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5wcfn\"/\"default-dockercfg-kz8xh\"" Jun 08 19:53:05.972449 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.972317 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4"] Jun 08 19:53:05.982936 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:05.982914 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be55592c-b758-4267-b309-634b1644bafd/kube-rbac-proxy-web/0.log" Jun 08 19:53:06.030298 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.030266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-proc\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.030501 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.030331 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-podres\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.030501 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.030403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6thq\" (UniqueName: \"kubernetes.io/projected/e452086b-8a55-4cd4-8a77-a61c4b0671a9-kube-api-access-g6thq\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.030501 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.030468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-lib-modules\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.030501 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.030496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-sys\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.041973 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.041949 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be55592c-b758-4267-b309-634b1644bafd/kube-rbac-proxy/0.log" Jun 08 19:53:06.081597 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.081571 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be55592c-b758-4267-b309-634b1644bafd/kube-rbac-proxy-thanos/0.log" Jun 08 19:53:06.131000 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.130969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6thq\" (UniqueName: \"kubernetes.io/projected/e452086b-8a55-4cd4-8a77-a61c4b0671a9-kube-api-access-g6thq\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.131127 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.131009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-lib-modules\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.131127 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.131029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-sys\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.131127 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.131088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-proc\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.131301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.131161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-lib-modules\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.131301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.131171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-podres\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.131301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.131182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-sys\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.131301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.131239 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-proc\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.131301 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.131272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e452086b-8a55-4cd4-8a77-a61c4b0671a9-podres\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.150848 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.150816 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be55592c-b758-4267-b309-634b1644bafd/init-config-reloader/0.log" Jun 08 19:53:06.151854 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.151831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6thq\" (UniqueName: \"kubernetes.io/projected/e452086b-8a55-4cd4-8a77-a61c4b0671a9-kube-api-access-g6thq\") pod \"perf-node-gather-daemonset-pp6t4\" (UID: \"e452086b-8a55-4cd4-8a77-a61c4b0671a9\") " pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.251229 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.251138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:06.406719 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.406692 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4"] Jun 08 19:53:06.407491 ip-10-0-133-234 kubenswrapper[2562]: W0608 19:53:06.407470 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode452086b_8a55_4cd4_8a77_a61c4b0671a9.slice/crio-21971f1f235cbde99e9a8793a08eb0e67fe1b988a0f0be7aaf5b48f93523e14b WatchSource:0}: Error finding container 21971f1f235cbde99e9a8793a08eb0e67fe1b988a0f0be7aaf5b48f93523e14b: Status 404 returned error can't find the container with id 21971f1f235cbde99e9a8793a08eb0e67fe1b988a0f0be7aaf5b48f93523e14b Jun 08 19:53:06.462501 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:06.462477 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-fr8wb_ecb37c0c-a207-4ccf-8549-76c5216d4755/prometheus-operator-admission-webhook/0.log" Jun 08 19:53:07.074654 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:07.074621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" event={"ID":"e452086b-8a55-4cd4-8a77-a61c4b0671a9","Type":"ContainerStarted","Data":"10ae5d7bef6f951a6cea2646158707a8117c3148bbec109e7f8cfeae2fd455f1"} Jun 08 19:53:07.075051 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:07.074677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" event={"ID":"e452086b-8a55-4cd4-8a77-a61c4b0671a9","Type":"ContainerStarted","Data":"21971f1f235cbde99e9a8793a08eb0e67fe1b988a0f0be7aaf5b48f93523e14b"} Jun 08 19:53:07.075051 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:07.074727 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:07.106339 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:07.106291 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" podStartSLOduration=2.106275309 podStartE2EDuration="2.106275309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 19:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 19:53:07.104888452 +0000 UTC m=+1173.659908918" watchObservedRunningTime="2026-06-08 19:53:07.106275309 +0000 UTC m=+1173.661295775" Jun 08 19:53:09.025752 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:09.025716 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/2.log" Jun 08 19:53:09.030199 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:09.030177 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9qhqx_eecda70f-18fd-4432-bc6c-fb293c150cdc/console-operator/3.log" Jun 08 19:53:11.770232 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:11.770204 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8cxxj_39b49e66-5334-4ffb-926b-dad8d5d0f42a/dns/0.log" Jun 08 19:53:11.812182 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:11.812152 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8cxxj_39b49e66-5334-4ffb-926b-dad8d5d0f42a/kube-rbac-proxy/0.log" Jun 08 19:53:12.136694 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:12.136661 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xbc4h_3a09e5c9-6a4d-4261-8eaa-0df67a903e2e/dns-node-resolver/0.log" Jun 08 19:53:12.981204 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:12.981177 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9hfwf_aef26922-f1bc-4db5-ad6d-89ac2e3adea4/node-ca/0.log" Jun 08 19:53:13.091089 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:13.091062 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5wcfn/perf-node-gather-daemonset-pp6t4" Jun 08 19:53:14.618507 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:14.618473 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958qn76_1e6bb836-f6c4-4327-95e4-6603bc8eabb1/istio-proxy/0.log" Jun 08 19:53:14.961349 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:14.961308 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tk9vf_91c8e435-cbea-4786-af59-c786089e2408/istio-proxy/1.log" Jun 08 19:53:14.961683 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:14.961665 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tk9vf_91c8e435-cbea-4786-af59-c786089e2408/istio-proxy/0.log" Jun 08 19:53:16.265592 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:16.265502 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z45f2_5dbb6b86-bd1d-4e2d-a79c-cf524764b62a/serve-healthcheck-canary/0.log" Jun 08 19:53:17.225077 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:17.225049 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-fbczw_3a49d924-67c1-4f3c-bfd5-d296abb7196d/insights-operator/1.log" Jun 08 19:53:17.227035 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:17.227016 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-fbczw_3a49d924-67c1-4f3c-bfd5-d296abb7196d/insights-operator/0.log" Jun 08 19:53:17.591377 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:17.591346 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mmbkl_57c0aaca-39a8-4cf5-b230-0c26a71388b3/kube-rbac-proxy/0.log" Jun 08 19:53:17.646390 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:17.646368 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mmbkl_57c0aaca-39a8-4cf5-b230-0c26a71388b3/exporter/0.log" Jun 08 19:53:17.725184 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:17.725161 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mmbkl_57c0aaca-39a8-4cf5-b230-0c26a71388b3/extractor/0.log" Jun 08 19:53:20.659341 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:20.659308 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958qn76_1e6bb836-f6c4-4327-95e4-6603bc8eabb1/istio-proxy/0.log" Jun 08 19:53:20.908591 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:20.908547 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tk9vf_91c8e435-cbea-4786-af59-c786089e2408/istio-proxy/1.log" Jun 08 19:53:20.908916 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:20.908896 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tk9vf_91c8e435-cbea-4786-af59-c786089e2408/istio-proxy/0.log" Jun 08 19:53:21.141945 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:21.141921 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7b9bfd4b8b-zkvn5_8276115d-f4a6-4ca7-a9d5-7c4129c3cfa9/nginx/0.log" Jun 08 19:53:21.369609 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:21.369569 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d79d8c5d-sxzvd_c17a3616-f43e-4dc0-8cc4-cc8f607861c2/maas-api/0.log" Jun 08 19:53:22.333884 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:22.333848 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958qn76_1e6bb836-f6c4-4327-95e4-6603bc8eabb1/istio-proxy/0.log" Jun 08 19:53:22.394452 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:22.394398 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b897fbc-wl2zb_24a9e964-18be-47c1-8d33-fef00907ca5c/manager/0.log" Jun 08 19:53:22.458423 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:22.458313 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b897fbc-wl2zb_24a9e964-18be-47c1-8d33-fef00907ca5c/copy-manifests/0.log" Jun 08 19:53:22.521663 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:22.521633 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tk9vf_91c8e435-cbea-4786-af59-c786089e2408/istio-proxy/0.log" Jun 08 19:53:22.525201 ip-10-0-133-234 kubenswrapper[2562]: I0608 19:53:22.525179 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tk9vf_91c8e435-cbea-4786-af59-c786089e2408/istio-proxy/1.log"