Jul 13 22:11:30.450371 ip-10-0-132-225 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 22:11:30.450385 ip-10-0-132-225 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 22:11:30.450395 ip-10-0-132-225 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 22:11:30.450732 ip-10-0-132-225 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 22:11:40.673589 ip-10-0-132-225 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 22:11:40.673605 ip-10-0-132-225 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 58f662de4081483595dab62daa585286 -- Jul 13 22:13:41.863774 ip-10-0-132-225 systemd[1]: Starting Kubernetes Kubelet... Jul 13 22:13:42.289364 ip-10-0-132-225 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 22:13:42.289364 ip-10-0-132-225 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 22:13:42.289364 ip-10-0-132-225 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 22:13:42.289364 ip-10-0-132-225 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 22:13:42.289364 ip-10-0-132-225 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 22:13:42.293077 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.292986 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 22:13:42.298600 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298585 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:42.298600 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298601 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298606 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298609 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298612 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298614 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298617 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298626 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298629 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298631 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298634 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298636 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298639 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298641 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298644 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298646 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298649 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298652 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298654 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298657 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:42.298663 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298659 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298663 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298668 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298671 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298674 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298676 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298679 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298681 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298684 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298686 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298688 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298691 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298693 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298695 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298698 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298700 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298702 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298705 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298707 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298710 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:42.299114 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298712 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298714 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298718 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298722 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298725 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298728 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298730 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298733 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298736 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298738 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298740 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298743 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298745 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298748 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298751 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298754 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298757 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298760 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298762 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:42.299622 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298766 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298770 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298773 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298775 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298778 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298781 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298783 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298786 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298788 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298791 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298793 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298796 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298798 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298801 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298803 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298806 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298808 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298810 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298813 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298815 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:42.300115 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298818 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298820 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298823 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298825 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298827 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298830 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298833 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298836 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298838 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298842 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298844 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298847 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298849 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298851 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298854 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298857 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298859 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298862 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298864 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.298866 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:42.300939 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299576 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299584 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299587 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299589 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299592 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299595 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299597 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299600 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299603 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299605 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299608 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299611 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299614 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299616 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299619 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299621 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299624 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299627 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299630 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299633 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:42.301514 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299636 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299639 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299641 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299644 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299647 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299649 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299652 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299655 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299659 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299663 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299666 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299669 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299672 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299674 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299677 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299679 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299682 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299685 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299688 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:42.302044 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299690 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299693 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299695 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299699 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299702 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299706 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299708 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299711 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299714 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299717 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299719 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299721 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299724 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299726 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299729 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299731 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299734 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299736 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299738 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:42.302526 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299744 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299748 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299752 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299755 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299758 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299760 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299763 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299765 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299768 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299770 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299773 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299775 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299778 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299780 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299783 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299785 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299788 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299790 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299792 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299795 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:42.302992 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299797 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299800 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299803 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299806 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299808 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299810 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299813 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299815 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299818 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299820 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299822 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299825 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299829 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299831 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299833 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299836 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299838 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299841 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299843 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299846 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:42.303509 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.299848 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301268 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301282 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301285 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301289 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301293 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301295 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301298 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301302 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301304 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301307 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301310 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301312 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301315 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301318 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301320 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301323 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301325 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301329 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:42.304091 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301331 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301335 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301338 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301341 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301343 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301346 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301348 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301351 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301355 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301358 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301361 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301364 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301367 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301370 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301374 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301380 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301383 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301386 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301389 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:42.304576 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301391 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301394 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301397 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301400 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301402 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301405 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301407 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301410 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301412 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301415 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301417 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301434 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301437 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301439 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301442 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301444 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301447 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301449 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301452 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301454 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:42.305042 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301457 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301459 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301461 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301464 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301466 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301469 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301474 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301479 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301481 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301484 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301486 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301489 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301491 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301494 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301496 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301498 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301501 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301504 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301506 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301509 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:42.305580 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301511 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301513 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301516 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301519 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301521 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301524 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301526 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301529 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301531 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301534 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301536 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301539 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301541 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301543 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301546 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301548 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301551 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301554 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301557 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301560 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:42.306065 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301562 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.301564 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301637 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301646 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301652 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301657 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301661 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301664 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301668 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301672 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301675 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301678 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301681 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301684 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301687 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301690 2577 flags.go:64] FLAG: --cgroup-root="" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301693 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301695 2577 flags.go:64] FLAG: --client-ca-file="" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301699 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301702 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301707 2577 flags.go:64] FLAG: --cluster-domain="" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301709 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301712 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301716 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 22:13:42.306578 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301719 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301722 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301725 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301728 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301731 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301735 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301737 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301740 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301744 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301746 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301750 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301753 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301756 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301759 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301762 2577 flags.go:64] FLAG: --enable-server="true" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301765 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301769 2577 flags.go:64] FLAG: --event-burst="100" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301772 2577 flags.go:64] FLAG: --event-qps="50" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301775 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301777 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301780 2577 flags.go:64] FLAG: --eviction-hard="" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301785 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301788 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301791 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301793 2577 flags.go:64] FLAG: --eviction-soft="" Jul 13 22:13:42.307185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301796 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301799 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301802 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301805 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301808 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301811 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301814 2577 flags.go:64] FLAG: --feature-gates="" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301817 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301820 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301823 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301826 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301829 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301832 2577 flags.go:64] FLAG: --help="false" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301835 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301838 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301840 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301843 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301847 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301850 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301853 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301855 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301858 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301861 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 22:13:42.307806 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301864 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301867 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301869 2577 flags.go:64] FLAG: --kube-reserved="" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301872 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301875 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301877 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301880 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301883 2577 flags.go:64] FLAG: --lock-file="" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301885 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301888 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301891 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301901 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301905 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301907 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301910 2577 flags.go:64] FLAG: --logging-format="text" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301913 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301916 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301919 2577 flags.go:64] FLAG: --manifest-url="" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301922 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301926 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301929 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301934 2577 flags.go:64] FLAG: --max-pods="110" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301936 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301939 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301942 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 22:13:42.308401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301945 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301948 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301951 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301953 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301961 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301964 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301967 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301970 2577 flags.go:64] FLAG: --pod-cidr="" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301972 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301978 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301981 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301984 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301986 2577 flags.go:64] FLAG: --port="10250" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301989 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301992 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0361ee290fcbedb10" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301995 2577 flags.go:64] FLAG: --qos-reserved="" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.301998 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302001 2577 flags.go:64] FLAG: --register-node="true" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302003 2577 flags.go:64] FLAG: --register-with-taints="" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302007 2577 flags.go:64] FLAG: --registry-burst="10" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302010 2577 flags.go:64] FLAG: --registry-qps="5" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302014 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302017 2577 flags.go:64] FLAG: --reserved-memory="" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302021 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302023 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 22:13:42.309035 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302026 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302029 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302031 2577 flags.go:64] FLAG: --runonce="false" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302034 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302040 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302043 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302046 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302048 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302051 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302054 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302058 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302060 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302064 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302066 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302069 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302072 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302075 2577 flags.go:64] FLAG: --system-cgroups="" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302077 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302083 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302085 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302088 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302092 2577 flags.go:64] FLAG: --tls-min-version="" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302095 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302097 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302100 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 22:13:42.309656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302103 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302105 2577 flags.go:64] FLAG: --v="2" Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302110 2577 flags.go:64] FLAG: --version="false" Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302115 2577 flags.go:64] FLAG: --vmodule="" Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302119 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.302122 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302268 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302273 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302276 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302279 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302283 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302288 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302292 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302294 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302297 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302300 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302303 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302306 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302308 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302311 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302313 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:42.310261 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302316 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302318 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302321 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302323 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302326 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302329 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302331 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302334 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302336 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302339 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302341 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302343 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302346 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302348 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302351 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302354 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302357 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302359 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302363 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302367 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:42.310826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302370 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302372 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302376 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302379 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302382 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302384 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302387 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302389 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302392 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302394 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302397 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302399 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302402 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302404 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302407 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302409 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302412 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302414 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302417 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302438 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:42.311324 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302441 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302443 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302445 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302448 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302451 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302453 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302457 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302459 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302462 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302465 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302467 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302470 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302474 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302477 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302481 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302484 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302486 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302488 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302491 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:42.311826 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302494 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302496 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302499 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302501 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302504 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302507 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302509 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302512 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302514 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302517 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302519 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302522 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302524 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302527 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302529 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302532 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302534 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302537 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302539 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:42.312300 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302543 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302545 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302548 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302551 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302554 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.302556 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.303230 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.309928 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.309942 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.309961 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.309967 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310027 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310032 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310035 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:42.312791 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310038 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310041 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310044 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310046 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310049 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310052 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310055 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310057 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310060 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310062 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310065 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310067 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310070 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310072 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310074 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310077 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310079 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310082 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310084 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310086 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310089 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:42.313152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310091 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310094 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310096 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310099 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310101 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310106 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310109 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310111 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310114 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310116 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310119 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310121 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310124 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310126 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310128 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310131 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310133 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310136 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310138 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310141 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:42.313680 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310143 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310147 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310150 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310153 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310156 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310158 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310162 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310166 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310169 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310172 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310175 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310177 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310180 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310182 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310184 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310187 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310190 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310192 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310195 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:42.314163 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310198 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310200 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310202 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310205 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310207 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310210 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310212 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310214 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310217 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310219 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310221 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310224 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310226 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310228 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310231 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310234 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310236 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310238 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310241 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:42.314640 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310243 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310245 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310248 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310250 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310253 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310257 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310260 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310263 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310265 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310268 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310271 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310274 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310277 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310280 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310283 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310285 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:42.315101 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310287 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.310292 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310433 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310439 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310442 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310445 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310447 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310450 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310452 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310454 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310457 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310460 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310462 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310465 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310467 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:42.315517 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310470 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310473 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310475 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310477 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310480 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310483 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310486 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310488 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310490 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310493 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310495 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310497 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310500 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310502 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310504 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310507 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310510 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310512 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310514 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310516 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:42.315888 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310519 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310521 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310525 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310528 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310531 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310533 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310536 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310539 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310542 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310544 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310547 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310549 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310552 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310554 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310557 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310559 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310562 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310564 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310567 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:42.316371 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310569 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310572 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310574 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310576 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310578 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310581 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310583 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310585 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310588 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310592 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310595 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310597 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310599 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310602 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310604 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310606 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310609 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310611 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310613 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310616 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:42.316852 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310618 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310621 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310623 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310625 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310628 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310631 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310633 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310635 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310638 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310641 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310647 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310650 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310653 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310655 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310658 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310661 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310663 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310666 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310668 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310670 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:42.317334 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310673 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310675 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310678 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310681 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310684 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310687 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:42.310689 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.310694 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.310811 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.312778 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.314088 2577 server.go:1019] "Starting client certificate rotation" Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.314187 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.314217 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 22:13:42.317902 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.316929 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 22:13:42.318467 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.318453 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 22:13:42.330179 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.330161 2577 log.go:25] "Validated CRI v1 runtime API" Jul 13 22:13:42.332886 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.332870 2577 log.go:25] "Validated CRI v1 image API" Jul 13 22:13:42.333653 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.333635 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 22:13:42.336411 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.336391 2577 fs.go:135] Filesystem UUIDs: map[5efd9c8c-a90b-4b12-b1e1-8a1943762992:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 966ea830-d8b2-465c-8849-10f39847c8b0:/dev/nvme0n1p4] Jul 13 22:13:42.336489 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.336410 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 22:13:42.341896 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.341879 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 22:13:42.343173 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.343063 2577 manager.go:216] Machine: {Timestamp:2026-07-13 22:13:42.341494188 +0000 UTC m=+0.355490962 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3163678 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec275901679b63511cc63cd83c0cdffc SystemUUID:ec275901-679b-6351-1cc6-3cd83c0cdffc BootID:58f662de-4081-4835-95da-b62daa585286 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:8a:42:e5:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:8a:42:e5:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:91:02:bd:80:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 22:13:42.343267 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.343174 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 22:13:42.343307 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.343282 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 22:13:42.346101 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.346072 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 22:13:42.346249 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.346107 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-225.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 22:13:42.347534 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.347523 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 22:13:42.347568 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.347538 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 22:13:42.347568 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.347545 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 22:13:42.348193 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.348183 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 22:13:42.349692 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.349681 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 22:13:42.353223 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.353211 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 13 22:13:42.353338 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.353328 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 22:13:42.353389 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.353360 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 13 22:13:42.353389 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.353378 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 22:13:42.353477 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.353392 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 22:13:42.353477 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.353402 2577 kubelet.go:398] "Adding apiserver pod source" Jul 13 22:13:42.353477 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.353411 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 22:13:42.353883 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.353859 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 22:13:42.353883 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.353879 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 22:13:42.356220 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.356201 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 22:13:42.358282 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.358265 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 22:13:42.358441 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.358304 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 22:13:42.358556 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.358542 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 22:13:42.358622 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.358571 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 22:13:42.358622 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.358586 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 22:13:42.358622 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.358602 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 22:13:42.358622 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.358618 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 22:13:42.358754 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.358627 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 22:13:42.359474 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.359462 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 22:13:42.359542 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.359476 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 22:13:42.359542 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.359495 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 22:13:42.359542 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.359505 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 22:13:42.359542 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.359517 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 22:13:42.359542 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.359530 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 22:13:42.360435 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.360409 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 22:13:42.360490 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.360440 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 22:13:42.364091 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.364069 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-225.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 22:13:42.364177 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.364096 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 22:13:42.364177 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.364126 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 22:13:42.364382 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.364369 2577 server.go:1268] "Started kubelet" Jul 13 22:13:42.364529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.364462 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 22:13:42.364574 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.364503 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 22:13:42.364634 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.364583 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 22:13:42.365521 ip-10-0-132-225 systemd[1]: Started Kubernetes Kubelet. Jul 13 22:13:42.369114 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.366033 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 22:13:42.370134 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.370115 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 13 22:13:42.371941 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.371921 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 22:13:42.373435 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.372441 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-225.ec2.internal.18c1f91b23215b5f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-225.ec2.internal,UID:ip-10-0-132-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-225.ec2.internal,},FirstTimestamp:2026-07-13 22:13:42.364248927 +0000 UTC m=+0.378245702,LastTimestamp:2026-07-13 22:13:42.364248927 +0000 UTC m=+0.378245702,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-225.ec2.internal,}" Jul 13 22:13:42.375280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.375264 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wwrt6" Jul 13 22:13:42.376565 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.376544 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 22:13:42.376656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.376545 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 22:13:42.376785 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.376768 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:42.377142 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377123 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 22:13:42.377218 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377127 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 22:13:42.377218 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377180 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 22:13:42.377314 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377297 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 13 22:13:42.377314 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377307 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 13 22:13:42.377396 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377349 2577 factory.go:55] Registering systemd factory Jul 13 22:13:42.377396 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377365 2577 factory.go:223] Registration of the systemd container factory successfully Jul 13 22:13:42.377663 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377649 2577 factory.go:153] Registering CRI-O factory Jul 13 22:13:42.377747 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377667 2577 factory.go:223] Registration of the crio container factory successfully Jul 13 22:13:42.377747 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377721 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 22:13:42.377747 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377743 2577 factory.go:103] Registering Raw factory Jul 13 22:13:42.377897 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.377760 2577 manager.go:1196] Started watching for new ooms in manager Jul 13 22:13:42.378252 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.378236 2577 manager.go:349] Starting recovery of all containers Jul 13 22:13:42.379050 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.379024 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 22:13:42.379145 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.379116 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 22:13:42.381570 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.381547 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wwrt6" Jul 13 22:13:42.386083 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.385922 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 22:13:42.386504 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.386481 2577 manager.go:354] Recovery completed Jul 13 22:13:42.391009 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.390990 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:42.393375 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.393357 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:42.393488 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.393390 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:42.393488 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.393405 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:42.393950 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.393935 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 22:13:42.393950 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.393949 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 22:13:42.394040 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.393966 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 13 22:13:42.394040 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.394016 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:42.394784 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.394771 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:42.394842 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.394796 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:42.394842 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.394814 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:42.395011 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.395001 2577 policy_none.go:49] "None policy: Start" Jul 13 22:13:42.395043 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.395017 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 22:13:42.395043 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.395027 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 22:13:42.396021 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.396012 2577 policy_none.go:47] "Start" Jul 13 22:13:42.433046 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.433024 2577 manager.go:337] "Starting Device Plugin manager" Jul 13 22:13:42.433157 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.433058 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 22:13:42.433157 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.433068 2577 server.go:87] "Starting device plugin registration server" Jul 13 22:13:42.433324 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.433312 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 22:13:42.433364 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.433327 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 22:13:42.433449 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.433410 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 22:13:42.433525 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.433514 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 22:13:42.433581 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.433526 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 22:13:42.434031 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.434014 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 22:13:42.434099 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.434057 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:42.533889 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.533860 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:42.534948 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.534824 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:42.534948 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.534854 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:42.534948 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.534865 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:42.534948 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.534892 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.549055 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.549002 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.549055 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.549025 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-225.ec2.internal\": node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:42.560346 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.560329 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 22:13:42.560438 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.560371 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 22:13:42.560438 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.560390 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 22:13:42.560507 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.560439 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 22:13:42.566855 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.566836 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:42.601003 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.600969 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:42.661232 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.661191 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal"] Jul 13 22:13:42.661330 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.661288 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:42.662322 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.662296 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:42.662408 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.662331 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:42.662408 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.662345 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:42.663708 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.663696 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:42.663849 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.663824 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.663896 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.663856 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:42.664498 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.664479 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:42.664498 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.664493 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:42.664639 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.664512 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:42.664639 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.664513 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:42.664639 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.664522 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:42.664639 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.664528 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:42.665754 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.665738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.665842 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.665762 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:42.666452 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.666438 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:42.666530 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.666466 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:42.666530 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.666479 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:42.678830 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.678805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/071cf27ef501a4509bfbc288bf41d536-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal\" (UID: \"071cf27ef501a4509bfbc288bf41d536\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.678927 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.678832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/071cf27ef501a4509bfbc288bf41d536-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal\" (UID: \"071cf27ef501a4509bfbc288bf41d536\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.678927 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.678849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/69e1b248276364992a05c6618a326633-config\") pod \"kube-apiserver-proxy-ip-10-0-132-225.ec2.internal\" (UID: \"69e1b248276364992a05c6618a326633\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.695109 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.695082 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-225.ec2.internal\" not found" node="ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.699622 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.699605 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-225.ec2.internal\" not found" node="ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.701659 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.701644 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:42.779003 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.778968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/071cf27ef501a4509bfbc288bf41d536-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal\" (UID: \"071cf27ef501a4509bfbc288bf41d536\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.779003 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.779002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/69e1b248276364992a05c6618a326633-config\") pod \"kube-apiserver-proxy-ip-10-0-132-225.ec2.internal\" (UID: \"69e1b248276364992a05c6618a326633\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.779211 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.779039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/071cf27ef501a4509bfbc288bf41d536-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal\" (UID: \"071cf27ef501a4509bfbc288bf41d536\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.779211 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.779081 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/071cf27ef501a4509bfbc288bf41d536-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal\" (UID: \"071cf27ef501a4509bfbc288bf41d536\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.779211 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.779098 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/071cf27ef501a4509bfbc288bf41d536-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal\" (UID: \"071cf27ef501a4509bfbc288bf41d536\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.779211 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.779084 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/69e1b248276364992a05c6618a326633-config\") pod \"kube-apiserver-proxy-ip-10-0-132-225.ec2.internal\" (UID: \"69e1b248276364992a05c6618a326633\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal" Jul 13 22:13:42.802805 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.802734 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:42.903801 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:42.903765 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:42.997369 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:42.997343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" Jul 13 22:13:43.002974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.002951 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal" Jul 13 22:13:43.004013 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:43.003997 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:43.105280 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:43.105189 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:43.207105 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:43.207068 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:43.238256 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.238225 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:43.307546 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:43.307506 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:43.313688 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.313663 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 22:13:43.313841 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.313822 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 22:13:43.313891 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.313827 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 22:13:43.385012 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.384919 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 22:08:42 +0000 UTC" deadline="2027-12-20 16:34:02.879040571 +0000 UTC" Jul 13 22:13:43.385012 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.384949 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12594h20m19.49409542s" Jul 13 22:13:43.408321 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:43.408283 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:43.508496 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:43.508459 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:43.575329 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.575305 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:43.579480 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:43.579446 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e1b248276364992a05c6618a326633.slice/crio-f08df05f350af4c82bbf2f429642f159144f6d6f41ea5d7d282d348a631a4e08 WatchSource:0}: Error finding container f08df05f350af4c82bbf2f429642f159144f6d6f41ea5d7d282d348a631a4e08: Status 404 returned error can't find the container with id f08df05f350af4c82bbf2f429642f159144f6d6f41ea5d7d282d348a631a4e08 Jul 13 22:13:43.584030 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.584016 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 22:13:43.608954 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:43.608918 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:43.676061 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:43.676031 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071cf27ef501a4509bfbc288bf41d536.slice/crio-75061cc390901bf31c105ee21d7cb83856921d7dc3499a5fdeef2108d489a4ed WatchSource:0}: Error finding container 75061cc390901bf31c105ee21d7cb83856921d7dc3499a5fdeef2108d489a4ed: Status 404 returned error can't find the container with id 75061cc390901bf31c105ee21d7cb83856921d7dc3499a5fdeef2108d489a4ed Jul 13 22:13:43.709623 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:43.709585 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-225.ec2.internal\" not found" Jul 13 22:13:43.788292 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.788263 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:43.877480 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.877441 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" Jul 13 22:13:43.891748 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.891725 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 22:13:43.892831 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.892818 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal" Jul 13 22:13:43.900448 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:43.900415 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 22:13:44.139495 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.139387 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:44.355036 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.354739 2577 apiserver.go:52] "Watching apiserver" Jul 13 22:13:44.363497 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.363452 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 22:13:44.364649 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.364618 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-l69tt","openshift-cluster-node-tuning-operator/tuned-mgp55","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal","openshift-multus/multus-additional-cni-plugins-62x9l","openshift-network-diagnostics/network-check-target-7fcsw","openshift-network-operator/iptables-alerter-w2nlg","openshift-ovn-kubernetes/ovnkube-node-n9f5l","kube-system/global-pull-secret-syncer-n9s5l","kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z","openshift-dns/node-resolver-6cgjt","openshift-image-registry/node-ca-9qzmj","openshift-multus/multus-26f7q","openshift-multus/network-metrics-daemon-nkrpc"] Jul 13 22:13:44.368689 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.368662 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.370356 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.370337 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.371971 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.371952 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:44.372089 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.372023 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:13:44.373187 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.373157 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 22:13:44.373448 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.373378 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.374612 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.374592 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 22:13:44.374878 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.374859 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 22:13:44.375070 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.375048 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 22:13:44.375371 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.375336 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wxjkw\"" Jul 13 22:13:44.375671 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.375652 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 22:13:44.375877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.375859 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 22:13:44.376110 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.376092 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 22:13:44.376435 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.376381 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 22:13:44.376739 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.376708 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 22:13:44.377001 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.376984 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ltgb7\"" Jul 13 22:13:44.377248 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.377192 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 22:13:44.377421 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.377404 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:44.377544 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.377492 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:13:44.377617 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.377603 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.378357 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.378340 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:44.378432 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.378400 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:13:44.378494 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.378445 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 22:13:44.379340 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.379310 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:13:44.381048 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.381027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.382161 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.382142 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6vmvl\"" Jul 13 22:13:44.382368 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.382337 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 22:13:44.382597 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.382579 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:13:44.382796 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.382775 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 22:13:44.383027 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.382998 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 22:13:44.384063 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.383301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7fllz\"" Jul 13 22:13:44.384063 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.383476 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 22:13:44.384063 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.383637 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:13:44.384063 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.383869 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6c546\"" Jul 13 22:13:44.384063 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.383981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.384750 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.384422 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 22:13:44.384750 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.384563 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 22:13:44.384852 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.384770 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 22:13:44.385369 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.385347 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.387590 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.386711 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 22:13:44.388114 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.387958 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f9dgc\"" Jul 13 22:13:44.388472 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.388207 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.388998 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.388975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-var-lib-openvswitch\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389074 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-run-ovn\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389074 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389074 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-kubelet\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389170 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-systemd-units\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389170 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-slash\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389170 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-run-netns\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389170 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-etc-openvswitch\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389368 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-node-log\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389368 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-cni-bin\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389368 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-run-openvswitch\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389368 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-run-systemd\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.389368 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.389308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-log-socket\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.397731 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.397675 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 22:13:44.397827 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.397753 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 22:13:44.402571 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.402547 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-47lqv\"" Jul 13 22:13:44.402899 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.402879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lxtpf\"" Jul 13 22:13:44.403211 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.403192 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f69c6\"" Jul 13 22:13:44.403291 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.403236 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 22:13:44.403383 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.403369 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 22:13:44.403450 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.403435 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 22:13:44.403667 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.403651 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 22:13:44.403737 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.403689 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 22:13:44.418423 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.417711 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 22:13:44.432865 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.432840 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ftvmp" Jul 13 22:13:44.437620 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.437592 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ftvmp" Jul 13 22:13:44.478188 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.478163 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 22:13:44.489993 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.489958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/452df3a9-14cc-4ee1-95cf-76511cc4a922-hosts-file\") pod \"node-resolver-6cgjt\" (UID: \"452df3a9-14cc-4ee1-95cf-76511cc4a922\") " pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.490121 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj8pv\" (UniqueName: \"kubernetes.io/projected/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-kube-api-access-hj8pv\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.490121 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-var-lib-kubelet\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.490121 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-run-systemd\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.490121 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1357a653-7f6f-4f90-b87f-30301c291f8e-env-overrides\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.490323 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-systemd\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.490323 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490162 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-var-lib-kubelet\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.490323 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-run-k8s-cni-cncf-io\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.490323 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-run-netns\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.490323 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-multus-conf-dir\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.490323 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-var-lib-openvswitch\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.490323 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.490323 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1c54dea-0793-4957-8d30-6d5426ca3f6b-host-slash\") pod \"iptables-alerter-w2nlg\" (UID: \"d1c54dea-0793-4957-8d30-6d5426ca3f6b\") " pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-sys\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-host\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490380 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-run-multus-certs\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-var-lib-cni-bin\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rck87\" (UniqueName: \"kubernetes.io/projected/914795a0-061c-487f-9c5c-6a281f3cb3cf-kube-api-access-rck87\") pod \"node-ca-9qzmj\" (UID: \"914795a0-061c-487f-9c5c-6a281f3cb3cf\") " pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-log-socket\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq5cf\" (UniqueName: \"kubernetes.io/projected/d1c54dea-0793-4957-8d30-6d5426ca3f6b-kube-api-access-rq5cf\") pod \"iptables-alerter-w2nlg\" (UID: \"d1c54dea-0793-4957-8d30-6d5426ca3f6b\") " pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-modprobe-d\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-sysctl-conf\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wfqh\" (UniqueName: \"kubernetes.io/projected/1452efde-f008-4841-872c-6476d32989d3-kube-api-access-8wfqh\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fbb4560a-0092-4378-b80b-d2d29109b1c8-kubelet-config\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-system-cni-dir\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.490707 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-cnibin\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/050c6150-cc8d-485b-a2cb-d1024dc55a68-cni-binary-copy\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4j8b\" (UniqueName: \"kubernetes.io/projected/452df3a9-14cc-4ee1-95cf-76511cc4a922-kube-api-access-d4j8b\") pod \"node-resolver-6cgjt\" (UID: \"452df3a9-14cc-4ee1-95cf-76511cc4a922\") " pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-slash\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-cni-bin\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/914795a0-061c-487f-9c5c-6a281f3cb3cf-serviceca\") pod \"node-ca-9qzmj\" (UID: \"914795a0-061c-487f-9c5c-6a281f3cb3cf\") " pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1357a653-7f6f-4f90-b87f-30301c291f8e-ovnkube-script-lib\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-socket-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-multus-cni-dir\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1452efde-f008-4841-872c-6476d32989d3-cni-binary-copy\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/050c6150-cc8d-485b-a2cb-d1024dc55a68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.490977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-registration-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-kubernetes\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.491145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-multus-socket-dir-parent\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2jr6\" (UniqueName: \"kubernetes.io/projected/389f6223-7e84-4f59-9168-e6229907c56d-kube-api-access-w2jr6\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-system-cni-dir\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/914795a0-061c-487f-9c5c-6a281f3cb3cf-host\") pod \"node-ca-9qzmj\" (UID: \"914795a0-061c-487f-9c5c-6a281f3cb3cf\") " pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-kubelet\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-etc-openvswitch\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vb45\" (UniqueName: \"kubernetes.io/projected/1357a653-7f6f-4f90-b87f-30301c291f8e-kube-api-access-2vb45\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-sysctl-d\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-os-release\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-device-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1357a653-7f6f-4f90-b87f-30301c291f8e-ovnkube-config\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-os-release\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491387 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-hostroot\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-etc-kubernetes\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452df3a9-14cc-4ee1-95cf-76511cc4a922-tmp-dir\") pod \"node-resolver-6cgjt\" (UID: \"452df3a9-14cc-4ee1-95cf-76511cc4a922\") " pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-etc-selinux\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.491719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-cni-netd\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1357a653-7f6f-4f90-b87f-30301c291f8e-ovn-node-metrics-cert\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1452efde-f008-4841-872c-6476d32989d3-multus-daemon-config\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-sys-fs\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-run-ovn\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-tmp\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-var-lib-cni-multus\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491785 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-cni-bin\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491936 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-slash\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491951 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-cnibin\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491976 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-kubelet\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492015 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-etc-openvswitch\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/050c6150-cc8d-485b-a2cb-d1024dc55a68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492046 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-log-socket\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492056 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-var-lib-openvswitch\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.492518 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.491936 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-run-systemd\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4-agent-certs\") pod \"konnectivity-agent-l69tt\" (UID: \"1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4\") " pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-systemd-units\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492089 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-run-ovn\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-run-netns\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492221 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-systemd-units\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-node-log\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492283 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-node-log\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d1c54dea-0793-4957-8d30-6d5426ca3f6b-iptables-alerter-script\") pod \"iptables-alerter-w2nlg\" (UID: \"d1c54dea-0793-4957-8d30-6d5426ca3f6b\") " pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-sysconfig\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492321 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-run-netns\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-run\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9jnl\" (UniqueName: \"kubernetes.io/projected/050c6150-cc8d-485b-a2cb-d1024dc55a68-kube-api-access-j9jnl\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-run-openvswitch\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fbb4560a-0092-4378-b80b-d2d29109b1c8-dbus\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-lib-modules\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492556 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-run-openvswitch\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.493119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-tuned\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.493743 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b86rh\" (UniqueName: \"kubernetes.io/projected/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-kube-api-access-b86rh\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.493743 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.492641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4-konnectivity-ca\") pod \"konnectivity-agent-l69tt\" (UID: \"1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4\") " pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:13:44.565982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.565915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" event={"ID":"071cf27ef501a4509bfbc288bf41d536","Type":"ContainerStarted","Data":"75061cc390901bf31c105ee21d7cb83856921d7dc3499a5fdeef2108d489a4ed"} Jul 13 22:13:44.567599 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.567566 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal" event={"ID":"69e1b248276364992a05c6618a326633","Type":"ContainerStarted","Data":"f08df05f350af4c82bbf2f429642f159144f6d6f41ea5d7d282d348a631a4e08"} Jul 13 22:13:44.593702 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1c54dea-0793-4957-8d30-6d5426ca3f6b-host-slash\") pod \"iptables-alerter-w2nlg\" (UID: \"d1c54dea-0793-4957-8d30-6d5426ca3f6b\") " pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.593893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-sys\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.593893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-host\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.593893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.593893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-run-multus-certs\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.593893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593805 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1c54dea-0793-4957-8d30-6d5426ca3f6b-host-slash\") pod \"iptables-alerter-w2nlg\" (UID: \"d1c54dea-0793-4957-8d30-6d5426ca3f6b\") " pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.593893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593833 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-sys\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.593893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.593893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593881 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-host\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.594280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-var-lib-cni-bin\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.594280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593939 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rck87\" (UniqueName: \"kubernetes.io/projected/914795a0-061c-487f-9c5c-6a281f3cb3cf-kube-api-access-rck87\") pod \"node-ca-9qzmj\" (UID: \"914795a0-061c-487f-9c5c-6a281f3cb3cf\") " pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.594280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593939 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-run-multus-certs\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.594280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq5cf\" (UniqueName: \"kubernetes.io/projected/d1c54dea-0793-4957-8d30-6d5426ca3f6b-kube-api-access-rq5cf\") pod \"iptables-alerter-w2nlg\" (UID: \"d1c54dea-0793-4957-8d30-6d5426ca3f6b\") " pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.594280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-modprobe-d\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.594280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594009 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-var-lib-cni-bin\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.594280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.593987 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.594280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-sysctl-conf\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.594280 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594193 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-sysctl-conf\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594298 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594301 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-modprobe-d\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wfqh\" (UniqueName: \"kubernetes.io/projected/1452efde-f008-4841-872c-6476d32989d3-kube-api-access-8wfqh\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fbb4560a-0092-4378-b80b-d2d29109b1c8-kubelet-config\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-system-cni-dir\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-cnibin\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594503 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-system-cni-dir\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/050c6150-cc8d-485b-a2cb-d1024dc55a68-cni-binary-copy\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4j8b\" (UniqueName: \"kubernetes.io/projected/452df3a9-14cc-4ee1-95cf-76511cc4a922-kube-api-access-d4j8b\") pod \"node-resolver-6cgjt\" (UID: \"452df3a9-14cc-4ee1-95cf-76511cc4a922\") " pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/914795a0-061c-487f-9c5c-6a281f3cb3cf-serviceca\") pod \"node-ca-9qzmj\" (UID: \"914795a0-061c-487f-9c5c-6a281f3cb3cf\") " pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1357a653-7f6f-4f90-b87f-30301c291f8e-ovnkube-script-lib\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-socket-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-multus-cni-dir\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1452efde-f008-4841-872c-6476d32989d3-cni-binary-copy\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fbb4560a-0092-4378-b80b-d2d29109b1c8-kubelet-config\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:44.594756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:44.595628 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.594762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/050c6150-cc8d-485b-a2cb-d1024dc55a68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.595628 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.594787 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:44.595628 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.594945 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs podName:389f6223-7e84-4f59-9168-e6229907c56d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:45.094908158 +0000 UTC m=+3.108904935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs") pod "network-metrics-daemon-nkrpc" (UID: "389f6223-7e84-4f59-9168-e6229907c56d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:44.595628 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.595177 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/914795a0-061c-487f-9c5c-6a281f3cb3cf-serviceca\") pod \"node-ca-9qzmj\" (UID: \"914795a0-061c-487f-9c5c-6a281f3cb3cf\") " pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.595628 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.595450 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-socket-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.595628 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.595537 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-multus-cni-dir\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.595944 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.595824 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/050c6150-cc8d-485b-a2cb-d1024dc55a68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.596003 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.595987 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1452efde-f008-4841-872c-6476d32989d3-cni-binary-copy\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.596291 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596153 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-cnibin\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.596291 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-registration-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.596291 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596253 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-registration-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-kubernetes\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-multus-socket-dir-parent\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2jr6\" (UniqueName: \"kubernetes.io/projected/389f6223-7e84-4f59-9168-e6229907c56d-kube-api-access-w2jr6\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596485 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-kubernetes\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596489 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-system-cni-dir\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.596522 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/914795a0-061c-487f-9c5c-6a281f3cb3cf-host\") pod \"node-ca-9qzmj\" (UID: \"914795a0-061c-487f-9c5c-6a281f3cb3cf\") " pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596540 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-system-cni-dir\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596485 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/050c6150-cc8d-485b-a2cb-d1024dc55a68-cni-binary-copy\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.596585 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.596572 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret podName:fbb4560a-0092-4378-b80b-d2d29109b1c8 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:45.096555393 +0000 UTC m=+3.110552152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret") pod "global-pull-secret-syncer-n9s5l" (UID: "fbb4560a-0092-4378-b80b-d2d29109b1c8") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vb45\" (UniqueName: \"kubernetes.io/projected/1357a653-7f6f-4f90-b87f-30301c291f8e-kube-api-access-2vb45\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596608 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1357a653-7f6f-4f90-b87f-30301c291f8e-ovnkube-script-lib\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596569 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-multus-socket-dir-parent\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-sysctl-d\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596617 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/914795a0-061c-487f-9c5c-6a281f3cb3cf-host\") pod \"node-ca-9qzmj\" (UID: \"914795a0-061c-487f-9c5c-6a281f3cb3cf\") " pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-os-release\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596759 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-device-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596772 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-os-release\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1357a653-7f6f-4f90-b87f-30301c291f8e-ovnkube-config\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596788 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-sysctl-d\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596887 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-device-dir\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-os-release\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-hostroot\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-etc-kubernetes\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596971 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-os-release\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.596993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452df3a9-14cc-4ee1-95cf-76511cc4a922-tmp-dir\") pod \"node-resolver-6cgjt\" (UID: \"452df3a9-14cc-4ee1-95cf-76511cc4a922\") " pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-etc-selinux\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.597149 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597026 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-hostroot\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597032 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-etc-kubernetes\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-cni-netd\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597082 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-cni-netd\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597166 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-etc-selinux\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1357a653-7f6f-4f90-b87f-30301c291f8e-ovn-node-metrics-cert\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597198 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1357a653-7f6f-4f90-b87f-30301c291f8e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1452efde-f008-4841-872c-6476d32989d3-multus-daemon-config\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-sys-fs\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-tmp\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-var-lib-cni-multus\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597364 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/452df3a9-14cc-4ee1-95cf-76511cc4a922-tmp-dir\") pod \"node-resolver-6cgjt\" (UID: \"452df3a9-14cc-4ee1-95cf-76511cc4a922\") " pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-cnibin\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1357a653-7f6f-4f90-b87f-30301c291f8e-ovnkube-config\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/050c6150-cc8d-485b-a2cb-d1024dc55a68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4-agent-certs\") pod \"konnectivity-agent-l69tt\" (UID: \"1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4\") " pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:13:44.597877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d1c54dea-0793-4957-8d30-6d5426ca3f6b-iptables-alerter-script\") pod \"iptables-alerter-w2nlg\" (UID: \"d1c54dea-0793-4957-8d30-6d5426ca3f6b\") " pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-sysconfig\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597548 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-run\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9jnl\" (UniqueName: \"kubernetes.io/projected/050c6150-cc8d-485b-a2cb-d1024dc55a68-kube-api-access-j9jnl\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fbb4560a-0092-4378-b80b-d2d29109b1c8-dbus\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-lib-modules\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-tuned\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b86rh\" (UniqueName: \"kubernetes.io/projected/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-kube-api-access-b86rh\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597778 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4-konnectivity-ca\") pod \"konnectivity-agent-l69tt\" (UID: \"1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4\") " pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/452df3a9-14cc-4ee1-95cf-76511cc4a922-hosts-file\") pod \"node-resolver-6cgjt\" (UID: \"452df3a9-14cc-4ee1-95cf-76511cc4a922\") " pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj8pv\" (UniqueName: \"kubernetes.io/projected/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-kube-api-access-hj8pv\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-var-lib-kubelet\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1357a653-7f6f-4f90-b87f-30301c291f8e-env-overrides\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.597990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-systemd\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-var-lib-kubelet\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-run-k8s-cni-cncf-io\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598044 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-sysconfig\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.598793 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598118 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/050c6150-cc8d-485b-a2cb-d1024dc55a68-cnibin\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598094 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-run\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598136 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-run-netns\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-multus-conf-dir\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598241 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-var-lib-cni-multus\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d1c54dea-0793-4957-8d30-6d5426ca3f6b-iptables-alerter-script\") pod \"iptables-alerter-w2nlg\" (UID: \"d1c54dea-0793-4957-8d30-6d5426ca3f6b\") " pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fbb4560a-0092-4378-b80b-d2d29109b1c8-dbus\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598365 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-sys-fs\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598359 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-var-lib-kubelet\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-systemd\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598600 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1452efde-f008-4841-872c-6476d32989d3-multus-daemon-config\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598657 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-var-lib-kubelet\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598735 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-run-k8s-cni-cncf-io\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598853 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/452df3a9-14cc-4ee1-95cf-76511cc4a922-hosts-file\") pod \"node-resolver-6cgjt\" (UID: \"452df3a9-14cc-4ee1-95cf-76511cc4a922\") " pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.599103 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-host-run-netns\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.598890 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/050c6150-cc8d-485b-a2cb-d1024dc55a68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.599126 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4-konnectivity-ca\") pod \"konnectivity-agent-l69tt\" (UID: \"1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4\") " pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.599173 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1452efde-f008-4841-872c-6476d32989d3-multus-conf-dir\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.599695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.599278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-lib-modules\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.600906 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.599932 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1357a653-7f6f-4f90-b87f-30301c291f8e-env-overrides\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.602002 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.601804 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-tmp\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.602002 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.601980 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4-agent-certs\") pod \"konnectivity-agent-l69tt\" (UID: \"1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4\") " pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:13:44.602138 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.601981 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-etc-tuned\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.602138 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.602129 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1357a653-7f6f-4f90-b87f-30301c291f8e-ovn-node-metrics-cert\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.609032 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.608996 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wfqh\" (UniqueName: \"kubernetes.io/projected/1452efde-f008-4841-872c-6476d32989d3-kube-api-access-8wfqh\") pod \"multus-26f7q\" (UID: \"1452efde-f008-4841-872c-6476d32989d3\") " pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.610400 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.610379 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq5cf\" (UniqueName: \"kubernetes.io/projected/d1c54dea-0793-4957-8d30-6d5426ca3f6b-kube-api-access-rq5cf\") pod \"iptables-alerter-w2nlg\" (UID: \"d1c54dea-0793-4957-8d30-6d5426ca3f6b\") " pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.612015 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.611993 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rck87\" (UniqueName: \"kubernetes.io/projected/914795a0-061c-487f-9c5c-6a281f3cb3cf-kube-api-access-rck87\") pod \"node-ca-9qzmj\" (UID: \"914795a0-061c-487f-9c5c-6a281f3cb3cf\") " pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:44.614015 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.613998 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:44.614084 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.614018 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:44.614084 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.614028 2577 projected.go:196] Error preparing data for projected volume kube-api-access-g2bpf for pod openshift-network-diagnostics/network-check-target-7fcsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:44.614162 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:44.614096 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf podName:844b435c-ca82-43b5-9918-8d7533f943cd nodeName:}" failed. No retries permitted until 2026-07-13 22:13:45.114082791 +0000 UTC m=+3.128079563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g2bpf" (UniqueName: "kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf") pod "network-check-target-7fcsw" (UID: "844b435c-ca82-43b5-9918-8d7533f943cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:44.617794 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.617745 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9jnl\" (UniqueName: \"kubernetes.io/projected/050c6150-cc8d-485b-a2cb-d1024dc55a68-kube-api-access-j9jnl\") pod \"multus-additional-cni-plugins-62x9l\" (UID: \"050c6150-cc8d-485b-a2cb-d1024dc55a68\") " pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.617966 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.617946 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj8pv\" (UniqueName: \"kubernetes.io/projected/a5b3f8ee-d915-44ce-8edc-cc3fe89ec728-kube-api-access-hj8pv\") pod \"aws-ebs-csi-driver-node-s4g4z\" (UID: \"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.618192 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.618173 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4j8b\" (UniqueName: \"kubernetes.io/projected/452df3a9-14cc-4ee1-95cf-76511cc4a922-kube-api-access-d4j8b\") pod \"node-resolver-6cgjt\" (UID: \"452df3a9-14cc-4ee1-95cf-76511cc4a922\") " pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.618264 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.618197 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2jr6\" (UniqueName: \"kubernetes.io/projected/389f6223-7e84-4f59-9168-e6229907c56d-kube-api-access-w2jr6\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:44.620377 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.620348 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vb45\" (UniqueName: \"kubernetes.io/projected/1357a653-7f6f-4f90-b87f-30301c291f8e-kube-api-access-2vb45\") pod \"ovnkube-node-n9f5l\" (UID: \"1357a653-7f6f-4f90-b87f-30301c291f8e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.622050 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.622028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b86rh\" (UniqueName: \"kubernetes.io/projected/acbf6ca3-042f-43d4-ba2b-84d2bba19da5-kube-api-access-b86rh\") pod \"tuned-mgp55\" (UID: \"acbf6ca3-042f-43d4-ba2b-84d2bba19da5\") " pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.694103 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.694020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:13:44.702760 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.702729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-26f7q" Jul 13 22:13:44.713817 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.713790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-62x9l" Jul 13 22:13:44.726782 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.726742 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w2nlg" Jul 13 22:13:44.737828 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.737804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:13:44.744699 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.744676 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mgp55" Jul 13 22:13:44.752815 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.752783 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" Jul 13 22:13:44.769726 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.769697 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cgjt" Jul 13 22:13:44.777621 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:44.777595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9qzmj" Jul 13 22:13:45.104062 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:45.103966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:45.104062 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:45.104015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:45.104303 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:45.104153 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:45.104303 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:45.104155 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:45.104303 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:45.104230 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret podName:fbb4560a-0092-4378-b80b-d2d29109b1c8 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:46.104204776 +0000 UTC m=+4.118201535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret") pod "global-pull-secret-syncer-n9s5l" (UID: "fbb4560a-0092-4378-b80b-d2d29109b1c8") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:45.104303 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:45.104252 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs podName:389f6223-7e84-4f59-9168-e6229907c56d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:46.104241426 +0000 UTC m=+4.118238187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs") pod "network-metrics-daemon-nkrpc" (UID: "389f6223-7e84-4f59-9168-e6229907c56d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:45.204892 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:45.204855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:45.205081 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:45.205061 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:45.205140 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:45.205088 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:45.205140 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:45.205100 2577 projected.go:196] Error preparing data for projected volume kube-api-access-g2bpf for pod openshift-network-diagnostics/network-check-target-7fcsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:45.205232 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:45.205161 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf podName:844b435c-ca82-43b5-9918-8d7533f943cd nodeName:}" failed. No retries permitted until 2026-07-13 22:13:46.205141911 +0000 UTC m=+4.219138670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2bpf" (UniqueName: "kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf") pod "network-check-target-7fcsw" (UID: "844b435c-ca82-43b5-9918-8d7533f943cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:45.441992 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:45.441901 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 22:08:44 +0000 UTC" deadline="2028-03-01 22:04:47.433110654 +0000 UTC" Jul 13 22:13:45.441992 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:45.441945 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14327h51m1.991171229s" Jul 13 22:13:45.761633 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:45.761256 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050c6150_cc8d_485b_a2cb_d1024dc55a68.slice/crio-941d7cf38944fa65ba742f6be36fc3f194e0ce3f0eb6b170f61ff4b7e3ee36e0 WatchSource:0}: Error finding container 941d7cf38944fa65ba742f6be36fc3f194e0ce3f0eb6b170f61ff4b7e3ee36e0: Status 404 returned error can't find the container with id 941d7cf38944fa65ba742f6be36fc3f194e0ce3f0eb6b170f61ff4b7e3ee36e0 Jul 13 22:13:45.764636 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:45.764604 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b3f8ee_d915_44ce_8edc_cc3fe89ec728.slice/crio-be06aae405bfffa6dddb78cf119485c03a87ec1da4f34dccca78e8627ba7ecb0 WatchSource:0}: Error finding container be06aae405bfffa6dddb78cf119485c03a87ec1da4f34dccca78e8627ba7ecb0: Status 404 returned error can't find the container with id be06aae405bfffa6dddb78cf119485c03a87ec1da4f34dccca78e8627ba7ecb0 Jul 13 22:13:45.774688 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:45.774570 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1452efde_f008_4841_872c_6476d32989d3.slice/crio-92f1e3565d881aa7cacee48f46c8d12aae7e19e63999be2f2e737ea220050df4 WatchSource:0}: Error finding container 92f1e3565d881aa7cacee48f46c8d12aae7e19e63999be2f2e737ea220050df4: Status 404 returned error can't find the container with id 92f1e3565d881aa7cacee48f46c8d12aae7e19e63999be2f2e737ea220050df4 Jul 13 22:13:45.776743 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:45.776719 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d75d3cd_0eb5_4cc1_ad0e_306d92c327f4.slice/crio-fc90f93f4cc048dc16667f8f1991e8fdbddf6f979b5e1dd522447436b5ca5c16 WatchSource:0}: Error finding container fc90f93f4cc048dc16667f8f1991e8fdbddf6f979b5e1dd522447436b5ca5c16: Status 404 returned error can't find the container with id fc90f93f4cc048dc16667f8f1991e8fdbddf6f979b5e1dd522447436b5ca5c16 Jul 13 22:13:45.796638 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:45.796615 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c54dea_0793_4957_8d30_6d5426ca3f6b.slice/crio-a145ef4567fead9f8f58f31775185a9effd8beb786d5be88ba6ab047236cb3cf WatchSource:0}: Error finding container a145ef4567fead9f8f58f31775185a9effd8beb786d5be88ba6ab047236cb3cf: Status 404 returned error can't find the container with id a145ef4567fead9f8f58f31775185a9effd8beb786d5be88ba6ab047236cb3cf Jul 13 22:13:45.798124 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:45.798102 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1357a653_7f6f_4f90_b87f_30301c291f8e.slice/crio-692ac3db352fb4a0aa0ac9248015c01fb7f3d7d8a9790c6e7232bc2d7e0bb317 WatchSource:0}: Error finding container 692ac3db352fb4a0aa0ac9248015c01fb7f3d7d8a9790c6e7232bc2d7e0bb317: Status 404 returned error can't find the container with id 692ac3db352fb4a0aa0ac9248015c01fb7f3d7d8a9790c6e7232bc2d7e0bb317 Jul 13 22:13:45.799780 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:45.799708 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914795a0_061c_487f_9c5c_6a281f3cb3cf.slice/crio-a7cd323d8375ead1cbb12acae78585ed2238a4c26fb459c94ee04dc1d0dba35b WatchSource:0}: Error finding container a7cd323d8375ead1cbb12acae78585ed2238a4c26fb459c94ee04dc1d0dba35b: Status 404 returned error can't find the container with id a7cd323d8375ead1cbb12acae78585ed2238a4c26fb459c94ee04dc1d0dba35b Jul 13 22:13:45.803349 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:13:45.803326 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452df3a9_14cc_4ee1_95cf_76511cc4a922.slice/crio-188d4200e1bd1682f597c1e809803ba542df38c157d931c1be673f4f312b08c8 WatchSource:0}: Error finding container 188d4200e1bd1682f597c1e809803ba542df38c157d931c1be673f4f312b08c8: Status 404 returned error can't find the container with id 188d4200e1bd1682f597c1e809803ba542df38c157d931c1be673f4f312b08c8 Jul 13 22:13:46.054750 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.054723 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:46.112351 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.112312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:46.112547 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.112364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:46.112547 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.112501 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:46.112626 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.112569 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs podName:389f6223-7e84-4f59-9168-e6229907c56d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:48.112555291 +0000 UTC m=+6.126552049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs") pod "network-metrics-daemon-nkrpc" (UID: "389f6223-7e84-4f59-9168-e6229907c56d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:46.112626 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.112504 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:46.112626 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.112607 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret podName:fbb4560a-0092-4378-b80b-d2d29109b1c8 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:48.112596273 +0000 UTC m=+6.126593031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret") pod "global-pull-secret-syncer-n9s5l" (UID: "fbb4560a-0092-4378-b80b-d2d29109b1c8") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:46.213669 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.213627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:46.213873 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.213833 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:46.213873 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.213856 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:46.213873 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.213866 2577 projected.go:196] Error preparing data for projected volume kube-api-access-g2bpf for pod openshift-network-diagnostics/network-check-target-7fcsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:46.214040 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.213935 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf podName:844b435c-ca82-43b5-9918-8d7533f943cd nodeName:}" failed. No retries permitted until 2026-07-13 22:13:48.213914167 +0000 UTC m=+6.227910959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2bpf" (UniqueName: "kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf") pod "network-check-target-7fcsw" (UID: "844b435c-ca82-43b5-9918-8d7533f943cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:46.442989 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.442874 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 22:08:44 +0000 UTC" deadline="2028-02-15 20:07:25.755579374 +0000 UTC" Jul 13 22:13:46.442989 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.442930 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13965h53m39.31265479s" Jul 13 22:13:46.563310 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.563273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:46.563520 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.563466 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:13:46.563974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.563941 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:46.564110 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.564087 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:13:46.564174 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.563950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:46.564232 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:46.564198 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:13:46.583728 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.583691 2577 generic.go:356] "Generic (PLEG): container finished" podID="071cf27ef501a4509bfbc288bf41d536" containerID="0fe09e136aae2a794ab4195ec357cb4941c70946a2f2f31ea2519ed0be42ea03" exitCode=0 Jul 13 22:13:46.584012 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.583990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" event={"ID":"071cf27ef501a4509bfbc288bf41d536","Type":"ContainerDied","Data":"0fe09e136aae2a794ab4195ec357cb4941c70946a2f2f31ea2519ed0be42ea03"} Jul 13 22:13:46.610866 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.610826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal" event={"ID":"69e1b248276364992a05c6618a326633","Type":"ContainerStarted","Data":"185821a1f72b40193d8828e5221635ec21e3eec86d5369df1c5061e209685213"} Jul 13 22:13:46.629026 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.628942 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-225.ec2.internal" podStartSLOduration=2.628912268 podStartE2EDuration="2.628912268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:46.628066107 +0000 UTC m=+4.642062891" watchObservedRunningTime="2026-07-13 22:13:46.628912268 +0000 UTC m=+4.642909054" Jul 13 22:13:46.634804 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.634767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l69tt" event={"ID":"1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4","Type":"ContainerStarted","Data":"fc90f93f4cc048dc16667f8f1991e8fdbddf6f979b5e1dd522447436b5ca5c16"} Jul 13 22:13:46.648198 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.648157 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mgp55" event={"ID":"acbf6ca3-042f-43d4-ba2b-84d2bba19da5","Type":"ContainerStarted","Data":"b2cda7e43a3479e8ea198cad663917e01d71d95e2e404723cc26bba289a32ed7"} Jul 13 22:13:46.662816 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.662710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-26f7q" event={"ID":"1452efde-f008-4841-872c-6476d32989d3","Type":"ContainerStarted","Data":"92f1e3565d881aa7cacee48f46c8d12aae7e19e63999be2f2e737ea220050df4"} Jul 13 22:13:46.671657 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.671617 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62x9l" event={"ID":"050c6150-cc8d-485b-a2cb-d1024dc55a68","Type":"ContainerStarted","Data":"941d7cf38944fa65ba742f6be36fc3f194e0ce3f0eb6b170f61ff4b7e3ee36e0"} Jul 13 22:13:46.689440 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.689104 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cgjt" event={"ID":"452df3a9-14cc-4ee1-95cf-76511cc4a922","Type":"ContainerStarted","Data":"188d4200e1bd1682f597c1e809803ba542df38c157d931c1be673f4f312b08c8"} Jul 13 22:13:46.699253 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.699124 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9qzmj" event={"ID":"914795a0-061c-487f-9c5c-6a281f3cb3cf","Type":"ContainerStarted","Data":"a7cd323d8375ead1cbb12acae78585ed2238a4c26fb459c94ee04dc1d0dba35b"} Jul 13 22:13:46.707133 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.707094 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerStarted","Data":"692ac3db352fb4a0aa0ac9248015c01fb7f3d7d8a9790c6e7232bc2d7e0bb317"} Jul 13 22:13:46.713477 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.713442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w2nlg" event={"ID":"d1c54dea-0793-4957-8d30-6d5426ca3f6b","Type":"ContainerStarted","Data":"a145ef4567fead9f8f58f31775185a9effd8beb786d5be88ba6ab047236cb3cf"} Jul 13 22:13:46.721555 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:46.721435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" event={"ID":"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728","Type":"ContainerStarted","Data":"be06aae405bfffa6dddb78cf119485c03a87ec1da4f34dccca78e8627ba7ecb0"} Jul 13 22:13:47.746165 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:47.746125 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" event={"ID":"071cf27ef501a4509bfbc288bf41d536","Type":"ContainerStarted","Data":"8da2d80d08df891dc401ba7afc13346cb81e9b2f84a506bf5e62dd325f07d25c"} Jul 13 22:13:47.768975 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:47.768862 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-225.ec2.internal" podStartSLOduration=3.768836954 podStartE2EDuration="3.768836954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:47.768060721 +0000 UTC m=+5.782057505" watchObservedRunningTime="2026-07-13 22:13:47.768836954 +0000 UTC m=+5.782833741" Jul 13 22:13:48.132835 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:48.131804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:48.132835 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:48.131873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:48.132835 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.132062 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:48.132835 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.132130 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret podName:fbb4560a-0092-4378-b80b-d2d29109b1c8 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.132110515 +0000 UTC m=+10.146107277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret") pod "global-pull-secret-syncer-n9s5l" (UID: "fbb4560a-0092-4378-b80b-d2d29109b1c8") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:48.132835 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.132596 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:48.132835 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.132732 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs podName:389f6223-7e84-4f59-9168-e6229907c56d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.132654026 +0000 UTC m=+10.146650788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs") pod "network-metrics-daemon-nkrpc" (UID: "389f6223-7e84-4f59-9168-e6229907c56d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:48.232662 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:48.232620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:48.232918 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.232875 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:48.232918 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.232908 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:48.233045 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.232922 2577 projected.go:196] Error preparing data for projected volume kube-api-access-g2bpf for pod openshift-network-diagnostics/network-check-target-7fcsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:48.233045 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.232985 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf podName:844b435c-ca82-43b5-9918-8d7533f943cd nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.2329649 +0000 UTC m=+10.246961661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2bpf" (UniqueName: "kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf") pod "network-check-target-7fcsw" (UID: "844b435c-ca82-43b5-9918-8d7533f943cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:48.562150 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:48.561585 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:48.562150 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:48.561620 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:48.562150 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.561735 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:13:48.562150 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:48.561809 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:48.562150 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.561938 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:13:48.562150 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:48.562030 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:13:50.565311 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:50.565239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:50.565311 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:50.565267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:50.565311 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:50.565239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:50.565832 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:50.565370 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:13:50.565832 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:50.565774 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:13:50.565898 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:50.565847 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:13:52.166742 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:52.166698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:52.167086 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:52.166756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:52.167086 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.166868 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:52.167086 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.166917 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret podName:fbb4560a-0092-4378-b80b-d2d29109b1c8 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:00.16690255 +0000 UTC m=+18.180899308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret") pod "global-pull-secret-syncer-n9s5l" (UID: "fbb4560a-0092-4378-b80b-d2d29109b1c8") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:52.167219 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.167205 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:52.167250 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.167244 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs podName:389f6223-7e84-4f59-9168-e6229907c56d nodeName:}" failed. No retries permitted until 2026-07-13 22:14:00.167233658 +0000 UTC m=+18.181230416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs") pod "network-metrics-daemon-nkrpc" (UID: "389f6223-7e84-4f59-9168-e6229907c56d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:52.267756 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:52.267704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:52.267981 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.267911 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:52.267981 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.267930 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:52.267981 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.267943 2577 projected.go:196] Error preparing data for projected volume kube-api-access-g2bpf for pod openshift-network-diagnostics/network-check-target-7fcsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:52.268144 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.267999 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf podName:844b435c-ca82-43b5-9918-8d7533f943cd nodeName:}" failed. No retries permitted until 2026-07-13 22:14:00.267983599 +0000 UTC m=+18.281980362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2bpf" (UniqueName: "kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf") pod "network-check-target-7fcsw" (UID: "844b435c-ca82-43b5-9918-8d7533f943cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:52.562257 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:52.562186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:52.562387 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.562313 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:13:52.562387 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:52.562355 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:52.562476 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:52.562412 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:52.562541 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.562514 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:13:52.562688 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:52.562666 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:13:54.562902 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:54.562870 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:54.563254 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:54.562965 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:13:54.563254 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:54.563251 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:54.563324 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:54.563311 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:13:54.563361 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:54.563344 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:54.563408 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:54.563394 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:13:56.561603 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:56.561560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:56.561603 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:56.561583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:56.562098 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:56.561583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:56.562098 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:56.561694 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:13:56.562098 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:56.561781 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:13:56.562098 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:56.561865 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:13:58.561457 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:58.561255 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:13:58.561457 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:58.561255 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:13:58.561457 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:58.561387 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:13:58.561457 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:13:58.561402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:13:58.561964 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:58.561489 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:13:58.561964 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:13:58.561559 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:00.233998 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:00.233963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:00.233998 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:00.234002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:00.234487 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.234103 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:14:00.234487 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.234123 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:14:00.234487 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.234149 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret podName:fbb4560a-0092-4378-b80b-d2d29109b1c8 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:16.234136063 +0000 UTC m=+34.248132820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret") pod "global-pull-secret-syncer-n9s5l" (UID: "fbb4560a-0092-4378-b80b-d2d29109b1c8") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:14:00.234487 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.234187 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs podName:389f6223-7e84-4f59-9168-e6229907c56d nodeName:}" failed. No retries permitted until 2026-07-13 22:14:16.234168285 +0000 UTC m=+34.248165044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs") pod "network-metrics-daemon-nkrpc" (UID: "389f6223-7e84-4f59-9168-e6229907c56d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:14:00.334325 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:00.334293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:00.334513 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.334493 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:14:00.334556 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.334524 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:14:00.334556 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.334536 2577 projected.go:196] Error preparing data for projected volume kube-api-access-g2bpf for pod openshift-network-diagnostics/network-check-target-7fcsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:14:00.334643 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.334592 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf podName:844b435c-ca82-43b5-9918-8d7533f943cd nodeName:}" failed. No retries permitted until 2026-07-13 22:14:16.334575518 +0000 UTC m=+34.348572275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2bpf" (UniqueName: "kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf") pod "network-check-target-7fcsw" (UID: "844b435c-ca82-43b5-9918-8d7533f943cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:14:00.561591 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:00.561510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:00.561754 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:00.561510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:00.561754 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.561634 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:00.561754 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:00.561510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:00.561754 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.561691 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:00.561955 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:00.561823 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:02.562574 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:02.562542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:02.563025 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:02.562645 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:02.563025 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:02.562675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:02.563025 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:02.562687 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:02.563025 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:02.562736 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:02.563025 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:02.562791 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:04.561513 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:04.561021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:04.561513 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:04.561020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:04.561513 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:04.561148 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:04.561513 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:04.561167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:04.561513 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:04.561292 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:04.561513 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:04.561384 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:05.786953 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.786550 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l69tt" event={"ID":"1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4","Type":"ContainerStarted","Data":"6bc8a7ad674355cad801f25ec20a83feaffbec2d8adc752410403cc04b52717c"} Jul 13 22:14:05.788798 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.788772 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mgp55" event={"ID":"acbf6ca3-042f-43d4-ba2b-84d2bba19da5","Type":"ContainerStarted","Data":"2c67d279ebcce5f61ae9af05b2b1de15f26ae8f1939f6b7a07c843fa989ab846"} Jul 13 22:14:05.790301 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.790276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-26f7q" event={"ID":"1452efde-f008-4841-872c-6476d32989d3","Type":"ContainerStarted","Data":"41311480ab222800ec38212a8ec22f389543d7a81f0e1e6f2c542496f7268f2b"} Jul 13 22:14:05.791966 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.791944 2577 generic.go:356] "Generic (PLEG): container finished" podID="050c6150-cc8d-485b-a2cb-d1024dc55a68" containerID="8205d2dc2db18e4c2f4ee357bd1b88295bd382fbec676faab1798cf96f1e6c9a" exitCode=0 Jul 13 22:14:05.792078 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.792009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62x9l" event={"ID":"050c6150-cc8d-485b-a2cb-d1024dc55a68","Type":"ContainerDied","Data":"8205d2dc2db18e4c2f4ee357bd1b88295bd382fbec676faab1798cf96f1e6c9a"} Jul 13 22:14:05.793653 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.793564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cgjt" event={"ID":"452df3a9-14cc-4ee1-95cf-76511cc4a922","Type":"ContainerStarted","Data":"6d57d7ec4482f3c58e8296648f0352566ad68edd2f5bdd9a28568d066bee7c82"} Jul 13 22:14:05.795173 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.795145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9qzmj" event={"ID":"914795a0-061c-487f-9c5c-6a281f3cb3cf","Type":"ContainerStarted","Data":"c201325112a90687158d2bd454065053c6b998dcb438cdb639cb85b99efca943"} Jul 13 22:14:05.798219 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.798195 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:14:05.798579 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.798558 2577 generic.go:356] "Generic (PLEG): container finished" podID="1357a653-7f6f-4f90-b87f-30301c291f8e" containerID="fd621c9ec1f4a757892b3c3951a5a85f7201b01803b7970f38dfc826ad462d41" exitCode=1 Jul 13 22:14:05.798669 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.798627 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerStarted","Data":"509434e8e69b2fc5eab593a1de8098320137afac69d4482c89c7a52b51cadc5f"} Jul 13 22:14:05.798718 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.798701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerStarted","Data":"807b296f069dc2c0cd75312dc1d36846a2ef0922e0a2fefd64afae36e3645063"} Jul 13 22:14:05.798770 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.798758 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerStarted","Data":"d8561146244837e41fc13ae59d037594c48c3395b23092baf8c9e219af5df615"} Jul 13 22:14:05.798816 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.798801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerStarted","Data":"cc6b8ecadcc8aead710caab35cb80f6128f52d6739c20879b33eb64ea709deed"} Jul 13 22:14:05.798865 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.798846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerDied","Data":"fd621c9ec1f4a757892b3c3951a5a85f7201b01803b7970f38dfc826ad462d41"} Jul 13 22:14:05.798921 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.798891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerStarted","Data":"71a4bb2592bb9a5b1c22204319a6faba737eecf7c4747c4829ee56f50daed8a8"} Jul 13 22:14:05.800795 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.800774 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" event={"ID":"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728","Type":"ContainerStarted","Data":"86ae25e86ce37360a172ae8430f3d416ac0d20203729dcee78d8dcba6b54ac09"} Jul 13 22:14:05.806342 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.806307 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l69tt" podStartSLOduration=7.616136142 podStartE2EDuration="22.806291061s" totalImagesPullingTime="15.190154919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:05.806253557 +0000 UTC m=+23.820250340" watchObservedRunningTime="2026-07-13 22:14:05.806291061 +0000 UTC m=+23.820287888" Jul 13 22:14:05.847344 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.847295 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mgp55" podStartSLOduration=3.8976626210000003 podStartE2EDuration="22.847282687s" totalImagesPullingTime="18.949620066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:05.846714625 +0000 UTC m=+23.860711400" watchObservedRunningTime="2026-07-13 22:14:05.847282687 +0000 UTC m=+23.861279466" Jul 13 22:14:05.865191 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.865148 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-26f7q" podStartSLOduration=3.648025782 podStartE2EDuration="22.86513531s" totalImagesPullingTime="19.217109528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:05.864689007 +0000 UTC m=+23.878685785" watchObservedRunningTime="2026-07-13 22:14:05.86513531 +0000 UTC m=+23.879132088" Jul 13 22:14:05.880730 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.880694 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6cgjt" podStartSLOduration=3.926064788 podStartE2EDuration="22.880681389s" totalImagesPullingTime="18.954616601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:05.879817549 +0000 UTC m=+23.893814328" watchObservedRunningTime="2026-07-13 22:14:05.880681389 +0000 UTC m=+23.894678167" Jul 13 22:14:05.915859 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:05.915823 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9qzmj" podStartSLOduration=4.008261042 podStartE2EDuration="22.915808394s" totalImagesPullingTime="18.907547352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:05.91559777 +0000 UTC m=+23.929594550" watchObservedRunningTime="2026-07-13 22:14:05.915808394 +0000 UTC m=+23.929805173" Jul 13 22:14:06.227944 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.227913 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 22:14:06.451013 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.450859 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T22:14:06.227929905Z","UUID":"162d2fb3-49d0-4198-9879-0e9eeb540bcc","Handler":null,"Name":"","Endpoint":""} Jul 13 22:14:06.452488 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.452467 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 22:14:06.452619 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.452502 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 22:14:06.561240 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.561209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:06.561240 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.561235 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:06.561488 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.561365 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:06.561488 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:06.561368 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:06.561488 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:06.561460 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:06.561617 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:06.561550 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:06.805382 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.805168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w2nlg" event={"ID":"d1c54dea-0793-4957-8d30-6d5426ca3f6b","Type":"ContainerStarted","Data":"40b7ba0c14caf3580254bd0e54200e3aeff70b245dee4bc975143195b75ed32f"} Jul 13 22:14:06.807400 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.807372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" event={"ID":"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728","Type":"ContainerStarted","Data":"25f645094cd048185f612713312de10a2cc73f366092b2cd3d1bdbc3d564e07c"} Jul 13 22:14:06.823348 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:06.823294 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w2nlg" podStartSLOduration=4.885153884 podStartE2EDuration="23.823275432s" totalImagesPullingTime="18.938121548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:06.823130694 +0000 UTC m=+24.837127473" watchObservedRunningTime="2026-07-13 22:14:06.823275432 +0000 UTC m=+24.837272214" Jul 13 22:14:07.813843 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:07.813616 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:14:07.814267 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:07.814201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerStarted","Data":"8d65b7ac125da4d099af848fc1f485815b6cfcfe95854cfff666b85d66f75f84"} Jul 13 22:14:07.816441 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:07.816390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" event={"ID":"a5b3f8ee-d915-44ce-8edc-cc3fe89ec728","Type":"ContainerStarted","Data":"1c8f7f94517e00657aa282f1440798384f171631c983c8eaf9272c5e07ca8aa4"} Jul 13 22:14:07.838860 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:07.838770 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4g4z" podStartSLOduration=3.682615081 podStartE2EDuration="24.838756273s" totalImagesPullingTime="21.156141192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:07.838693852 +0000 UTC m=+25.852690632" watchObservedRunningTime="2026-07-13 22:14:07.838756273 +0000 UTC m=+25.852753051" Jul 13 22:14:08.560828 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:08.560793 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:08.561019 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:08.560794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:08.561019 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:08.560916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:08.561019 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:08.560919 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:08.561019 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:08.560996 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:08.561231 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:08.561069 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:09.705158 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:09.705124 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:14:09.705905 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:09.705877 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:14:09.821597 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:09.821566 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:14:09.822132 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:09.822108 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l69tt" Jul 13 22:14:10.561481 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:10.561279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:10.561598 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:10.561281 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:10.561598 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:10.561568 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:10.561709 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:10.561326 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:10.561709 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:10.561628 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:10.561801 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:10.561753 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:10.825288 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:10.825257 2577 generic.go:356] "Generic (PLEG): container finished" podID="050c6150-cc8d-485b-a2cb-d1024dc55a68" containerID="f0774caee460cf9adb87745f9a5dd76934e4113e63c1b13b9e303ca74bc5766c" exitCode=0 Jul 13 22:14:10.826082 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:10.825337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62x9l" event={"ID":"050c6150-cc8d-485b-a2cb-d1024dc55a68","Type":"ContainerDied","Data":"f0774caee460cf9adb87745f9a5dd76934e4113e63c1b13b9e303ca74bc5766c"} Jul 13 22:14:10.828901 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:10.828884 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:14:10.829250 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:10.829226 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerStarted","Data":"71b6e5dddbb2c4311a958522b2172bff993f0171673b7d27daf59df1104e888d"} Jul 13 22:14:10.829703 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:10.829687 2577 scope.go:117] "RemoveContainer" containerID="fd621c9ec1f4a757892b3c3951a5a85f7201b01803b7970f38dfc826ad462d41" Jul 13 22:14:11.835512 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:11.835481 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:14:11.835944 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:11.835839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" event={"ID":"1357a653-7f6f-4f90-b87f-30301c291f8e","Type":"ContainerStarted","Data":"0c8c14550cdba3b9d7f477afdcf0698ad804bf11ca1086a5be77ae4c26ae7766"} Jul 13 22:14:11.836137 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:11.836114 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:14:11.836281 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:11.836189 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:14:11.836281 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:11.836236 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:14:11.851749 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:11.851725 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:14:11.851927 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:11.851852 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:14:11.871502 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:11.871459 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" podStartSLOduration=9.882969697 podStartE2EDuration="28.871446247s" totalImagesPullingTime="18.98847655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:11.87018106 +0000 UTC m=+29.884177838" watchObservedRunningTime="2026-07-13 22:14:11.871446247 +0000 UTC m=+29.885443017" Jul 13 22:14:12.561861 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:12.561824 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:12.562083 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:12.561927 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:12.562083 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:12.561935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:12.562083 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:12.561969 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:12.562083 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:12.562040 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:12.562268 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:12.562104 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:12.839932 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:12.839854 2577 generic.go:356] "Generic (PLEG): container finished" podID="050c6150-cc8d-485b-a2cb-d1024dc55a68" containerID="bf8dd6dfc9ea70fefdd706897924f2f209c9f853a389547101c70e08c3a70521" exitCode=0 Jul 13 22:14:12.840299 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:12.839933 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62x9l" event={"ID":"050c6150-cc8d-485b-a2cb-d1024dc55a68","Type":"ContainerDied","Data":"bf8dd6dfc9ea70fefdd706897924f2f209c9f853a389547101c70e08c3a70521"} Jul 13 22:14:13.844486 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:13.844389 2577 generic.go:356] "Generic (PLEG): container finished" podID="050c6150-cc8d-485b-a2cb-d1024dc55a68" containerID="462c6ffcfd0f9be746dbe5e49f961e4d44c3b58be929b2801cfb3b3cb9d22582" exitCode=0 Jul 13 22:14:13.844847 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:13.844476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62x9l" event={"ID":"050c6150-cc8d-485b-a2cb-d1024dc55a68","Type":"ContainerDied","Data":"462c6ffcfd0f9be746dbe5e49f961e4d44c3b58be929b2801cfb3b3cb9d22582"} Jul 13 22:14:14.561011 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:14.560629 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:14.561011 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:14.560641 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:14.561011 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:14.560754 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:14.561011 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:14.560772 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:14.561011 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:14.560889 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:14.561011 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:14.560981 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:16.248135 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:16.248103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:16.248135 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:16.248141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:16.248559 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.248250 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:14:16.248559 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.248250 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:14:16.248559 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.248314 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs podName:389f6223-7e84-4f59-9168-e6229907c56d nodeName:}" failed. No retries permitted until 2026-07-13 22:14:48.248300028 +0000 UTC m=+66.262296784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs") pod "network-metrics-daemon-nkrpc" (UID: "389f6223-7e84-4f59-9168-e6229907c56d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:14:16.248559 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.248328 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret podName:fbb4560a-0092-4378-b80b-d2d29109b1c8 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:48.248322449 +0000 UTC m=+66.262319206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret") pod "global-pull-secret-syncer-n9s5l" (UID: "fbb4560a-0092-4378-b80b-d2d29109b1c8") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:14:16.349217 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:16.349181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:16.349433 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.349331 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:14:16.349433 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.349346 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:14:16.349433 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.349358 2577 projected.go:196] Error preparing data for projected volume kube-api-access-g2bpf for pod openshift-network-diagnostics/network-check-target-7fcsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:14:16.349606 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.349445 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf podName:844b435c-ca82-43b5-9918-8d7533f943cd nodeName:}" failed. No retries permitted until 2026-07-13 22:14:48.349407018 +0000 UTC m=+66.363403800 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2bpf" (UniqueName: "kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf") pod "network-check-target-7fcsw" (UID: "844b435c-ca82-43b5-9918-8d7533f943cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:14:16.561072 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:16.561037 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:16.561072 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:16.561072 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:16.561319 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:16.561035 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:16.561319 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.561187 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:16.561415 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.561325 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:16.561415 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:16.561405 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:18.560854 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:18.560812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:18.561312 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:18.560812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:18.561312 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:18.560936 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:18.561312 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:18.560959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:18.561312 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:18.561050 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:18.561312 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:18.561129 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:18.858670 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:18.858588 2577 generic.go:356] "Generic (PLEG): container finished" podID="050c6150-cc8d-485b-a2cb-d1024dc55a68" containerID="fcec602a287fd907a60d981d017557ec70460c1df3d86858e5db4b9aa0180e45" exitCode=0 Jul 13 22:14:18.858670 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:18.858623 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62x9l" event={"ID":"050c6150-cc8d-485b-a2cb-d1024dc55a68","Type":"ContainerDied","Data":"fcec602a287fd907a60d981d017557ec70460c1df3d86858e5db4b9aa0180e45"} Jul 13 22:14:19.866341 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:19.866304 2577 generic.go:356] "Generic (PLEG): container finished" podID="050c6150-cc8d-485b-a2cb-d1024dc55a68" containerID="d921670b606c5dcd329adb433215bbd54a9aacd9fbad7e49937df37d8a1fbca6" exitCode=0 Jul 13 22:14:19.866341 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:19.866342 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62x9l" event={"ID":"050c6150-cc8d-485b-a2cb-d1024dc55a68","Type":"ContainerDied","Data":"d921670b606c5dcd329adb433215bbd54a9aacd9fbad7e49937df37d8a1fbca6"} Jul 13 22:14:20.560597 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:20.560566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:20.560797 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:20.560566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:20.560797 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:20.560665 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:20.560797 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:20.560566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:20.560797 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:20.560755 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:20.560981 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:20.560869 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:20.871365 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:20.871278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-62x9l" event={"ID":"050c6150-cc8d-485b-a2cb-d1024dc55a68","Type":"ContainerStarted","Data":"a76126ef8a7d83d79abbb3067499d65895860da4dfc7d6d9b6f8e35570339d19"} Jul 13 22:14:20.895484 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:20.895440 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-62x9l" podStartSLOduration=7.948070328 podStartE2EDuration="37.8954027s" totalImagesPullingTime="29.947332372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:20.89486787 +0000 UTC m=+38.908864672" watchObservedRunningTime="2026-07-13 22:14:20.8954027 +0000 UTC m=+38.909399478" Jul 13 22:14:22.562219 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:22.562178 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:22.562711 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:22.562279 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:22.562711 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:22.562288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:22.562711 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:22.562331 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:22.562711 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:22.562412 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:22.562711 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:22.562519 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:24.560947 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:24.560907 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:24.561415 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:24.560920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:24.561415 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:24.561036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:24.561415 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:24.561034 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:24.561415 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:24.561155 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:24.561415 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:24.561249 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:26.566649 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:26.566621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:26.567054 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:26.566621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:26.567054 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:26.566727 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:26.567054 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:26.566811 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:26.567054 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:26.566621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:26.567054 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:26.566885 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:27.408755 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:27.408718 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n9s5l"] Jul 13 22:14:27.408926 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:27.408854 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:27.409008 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:27.408977 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:27.415970 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:27.415926 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nkrpc"] Jul 13 22:14:27.416144 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:27.416066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:27.416206 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:27.416165 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:27.416735 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:27.416707 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7fcsw"] Jul 13 22:14:27.416876 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:27.416808 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:27.416946 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:27.416921 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:29.560695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:29.560663 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:29.561463 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:29.560663 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:29.561463 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:29.560776 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkrpc" podUID="389f6223-7e84-4f59-9168-e6229907c56d" Jul 13 22:14:29.561463 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:29.560663 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:29.561463 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:29.560855 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9s5l" podUID="fbb4560a-0092-4378-b80b-d2d29109b1c8" Jul 13 22:14:29.561463 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:29.560911 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7fcsw" podUID="844b435c-ca82-43b5-9918-8d7533f943cd" Jul 13 22:14:30.809351 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.809179 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-225.ec2.internal" event="NodeReady" Jul 13 22:14:30.809788 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.809480 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 22:14:30.874563 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.874534 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r8pbt"] Jul 13 22:14:30.887088 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.887058 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8dbnr"] Jul 13 22:14:30.887249 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.887175 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:30.890077 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.890052 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 22:14:30.891088 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.891057 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p77sr\"" Jul 13 22:14:30.891831 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.891788 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 22:14:30.899262 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.899241 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r8pbt"] Jul 13 22:14:30.899352 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.899275 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8dbnr"] Jul 13 22:14:30.899352 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.899344 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8dbnr" Jul 13 22:14:30.902005 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.901986 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 22:14:30.902115 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.901987 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 22:14:30.902115 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.902070 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 22:14:30.902291 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.902277 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9d5hg\"" Jul 13 22:14:30.962967 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.962937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d3bcba8-18a5-411e-a721-9b54cb862ff7-tmp-dir\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:30.963128 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.962977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1fae88-eb70-4e6d-932d-41c185e374d9-cert\") pod \"ingress-canary-8dbnr\" (UID: \"ea1fae88-eb70-4e6d-932d-41c185e374d9\") " pod="openshift-ingress-canary/ingress-canary-8dbnr" Jul 13 22:14:30.963128 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.962994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d3bcba8-18a5-411e-a721-9b54cb862ff7-config-volume\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:30.963128 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.963058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d3bcba8-18a5-411e-a721-9b54cb862ff7-metrics-tls\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:30.963240 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.963133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqr6g\" (UniqueName: \"kubernetes.io/projected/ea1fae88-eb70-4e6d-932d-41c185e374d9-kube-api-access-sqr6g\") pod \"ingress-canary-8dbnr\" (UID: \"ea1fae88-eb70-4e6d-932d-41c185e374d9\") " pod="openshift-ingress-canary/ingress-canary-8dbnr" Jul 13 22:14:30.963240 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.963171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p8lf\" (UniqueName: \"kubernetes.io/projected/5d3bcba8-18a5-411e-a721-9b54cb862ff7-kube-api-access-7p8lf\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:30.983474 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:30.983443 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fcgvn"] Jul 13 22:14:31.002567 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.002532 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fcgvn"] Jul 13 22:14:31.002713 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.002676 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.005441 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.005401 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 22:14:31.005593 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.005447 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 22:14:31.005593 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.005560 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 22:14:31.005593 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.005579 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w5vtc\"" Jul 13 22:14:31.005737 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.005616 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 22:14:31.063825 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.063739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p8lf\" (UniqueName: \"kubernetes.io/projected/5d3bcba8-18a5-411e-a721-9b54cb862ff7-kube-api-access-7p8lf\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:31.063825 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.063781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffe05c71-8f75-400c-8404-a50cf7807e14-data-volume\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.063825 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.063817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d3bcba8-18a5-411e-a721-9b54cb862ff7-tmp-dir\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:31.064103 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.063845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1fae88-eb70-4e6d-932d-41c185e374d9-cert\") pod \"ingress-canary-8dbnr\" (UID: \"ea1fae88-eb70-4e6d-932d-41c185e374d9\") " pod="openshift-ingress-canary/ingress-canary-8dbnr" Jul 13 22:14:31.064103 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.063864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d3bcba8-18a5-411e-a721-9b54cb862ff7-config-volume\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:31.064103 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.063963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ffe05c71-8f75-400c-8404-a50cf7807e14-crio-socket\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.064103 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.064012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d3bcba8-18a5-411e-a721-9b54cb862ff7-metrics-tls\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:31.064103 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.064051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxk9r\" (UniqueName: \"kubernetes.io/projected/ffe05c71-8f75-400c-8404-a50cf7807e14-kube-api-access-wxk9r\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.064103 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.064086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ffe05c71-8f75-400c-8404-a50cf7807e14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.064396 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.064124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqr6g\" (UniqueName: \"kubernetes.io/projected/ea1fae88-eb70-4e6d-932d-41c185e374d9-kube-api-access-sqr6g\") pod \"ingress-canary-8dbnr\" (UID: \"ea1fae88-eb70-4e6d-932d-41c185e374d9\") " pod="openshift-ingress-canary/ingress-canary-8dbnr" Jul 13 22:14:31.064396 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.064145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ffe05c71-8f75-400c-8404-a50cf7807e14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.064564 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.064543 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d3bcba8-18a5-411e-a721-9b54cb862ff7-tmp-dir\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:31.064815 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.064779 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d3bcba8-18a5-411e-a721-9b54cb862ff7-config-volume\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:31.068394 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.068371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1fae88-eb70-4e6d-932d-41c185e374d9-cert\") pod \"ingress-canary-8dbnr\" (UID: \"ea1fae88-eb70-4e6d-932d-41c185e374d9\") " pod="openshift-ingress-canary/ingress-canary-8dbnr" Jul 13 22:14:31.068394 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.068388 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d3bcba8-18a5-411e-a721-9b54cb862ff7-metrics-tls\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:31.071785 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.071760 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn"] Jul 13 22:14:31.077650 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.077623 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqr6g\" (UniqueName: \"kubernetes.io/projected/ea1fae88-eb70-4e6d-932d-41c185e374d9-kube-api-access-sqr6g\") pod \"ingress-canary-8dbnr\" (UID: \"ea1fae88-eb70-4e6d-932d-41c185e374d9\") " pod="openshift-ingress-canary/ingress-canary-8dbnr" Jul 13 22:14:31.077768 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.077725 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p8lf\" (UniqueName: \"kubernetes.io/projected/5d3bcba8-18a5-411e-a721-9b54cb862ff7-kube-api-access-7p8lf\") pod \"dns-default-r8pbt\" (UID: \"5d3bcba8-18a5-411e-a721-9b54cb862ff7\") " pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:31.091477 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.091451 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn"] Jul 13 22:14:31.091610 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.091543 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" Jul 13 22:14:31.094135 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.094113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 13 22:14:31.094307 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.094291 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qc6ht\"" Jul 13 22:14:31.164637 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.164601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ffe05c71-8f75-400c-8404-a50cf7807e14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.164809 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.164651 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffe05c71-8f75-400c-8404-a50cf7807e14-data-volume\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.164809 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.164721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ffe05c71-8f75-400c-8404-a50cf7807e14-crio-socket\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.164809 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.164770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxk9r\" (UniqueName: \"kubernetes.io/projected/ffe05c71-8f75-400c-8404-a50cf7807e14-kube-api-access-wxk9r\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.164809 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.164794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ffe05c71-8f75-400c-8404-a50cf7807e14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.164981 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.164835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26198bc0-fa80-45d6-9c06-b3ee5cd4d22e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9jkhn\" (UID: \"26198bc0-fa80-45d6-9c06-b3ee5cd4d22e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" Jul 13 22:14:31.164981 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.164954 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ffe05c71-8f75-400c-8404-a50cf7807e14-crio-socket\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.165058 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.164997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffe05c71-8f75-400c-8404-a50cf7807e14-data-volume\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.165241 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.165225 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ffe05c71-8f75-400c-8404-a50cf7807e14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.167332 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.167315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ffe05c71-8f75-400c-8404-a50cf7807e14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.173906 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.173883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxk9r\" (UniqueName: \"kubernetes.io/projected/ffe05c71-8f75-400c-8404-a50cf7807e14-kube-api-access-wxk9r\") pod \"insights-runtime-extractor-fcgvn\" (UID: \"ffe05c71-8f75-400c-8404-a50cf7807e14\") " pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.197854 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.197822 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:31.206948 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.206924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8dbnr" Jul 13 22:14:31.265718 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.265686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26198bc0-fa80-45d6-9c06-b3ee5cd4d22e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9jkhn\" (UID: \"26198bc0-fa80-45d6-9c06-b3ee5cd4d22e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" Jul 13 22:14:31.268296 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.268268 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26198bc0-fa80-45d6-9c06-b3ee5cd4d22e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9jkhn\" (UID: \"26198bc0-fa80-45d6-9c06-b3ee5cd4d22e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" Jul 13 22:14:31.312083 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.312041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fcgvn" Jul 13 22:14:31.375854 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.375542 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8dbnr"] Jul 13 22:14:31.396227 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.395492 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r8pbt"] Jul 13 22:14:31.400795 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.400020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" Jul 13 22:14:31.478585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.478557 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fcgvn"] Jul 13 22:14:31.482305 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:31.482273 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe05c71_8f75_400c_8404_a50cf7807e14.slice/crio-104f890317afc6dfdb48093dc3c54aecde8b0bead7d6314ee838c74fe247dd37 WatchSource:0}: Error finding container 104f890317afc6dfdb48093dc3c54aecde8b0bead7d6314ee838c74fe247dd37: Status 404 returned error can't find the container with id 104f890317afc6dfdb48093dc3c54aecde8b0bead7d6314ee838c74fe247dd37 Jul 13 22:14:31.546113 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.546081 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn"] Jul 13 22:14:31.549619 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:31.549592 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26198bc0_fa80_45d6_9c06_b3ee5cd4d22e.slice/crio-7a4e93b4861ab0531fcc8779495b7de15c1f7513a59c37de18a4a3c0d15df0f1 WatchSource:0}: Error finding container 7a4e93b4861ab0531fcc8779495b7de15c1f7513a59c37de18a4a3c0d15df0f1: Status 404 returned error can't find the container with id 7a4e93b4861ab0531fcc8779495b7de15c1f7513a59c37de18a4a3c0d15df0f1 Jul 13 22:14:31.561553 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.561533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:31.561654 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.561639 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:31.561714 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.561539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:31.564539 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.564517 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 22:14:31.564643 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.564542 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jtd57\"" Jul 13 22:14:31.564643 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.564554 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpxwn\"" Jul 13 22:14:31.564643 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.564587 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 22:14:31.564643 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.564610 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 22:14:31.564957 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.564941 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 22:14:31.898475 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.898366 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcgvn" event={"ID":"ffe05c71-8f75-400c-8404-a50cf7807e14","Type":"ContainerStarted","Data":"104f890317afc6dfdb48093dc3c54aecde8b0bead7d6314ee838c74fe247dd37"} Jul 13 22:14:31.899642 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.899617 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" event={"ID":"26198bc0-fa80-45d6-9c06-b3ee5cd4d22e","Type":"ContainerStarted","Data":"7a4e93b4861ab0531fcc8779495b7de15c1f7513a59c37de18a4a3c0d15df0f1"} Jul 13 22:14:31.900752 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.900729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8pbt" event={"ID":"5d3bcba8-18a5-411e-a721-9b54cb862ff7","Type":"ContainerStarted","Data":"55a807c0c55f6667e252a454c19326aeb47d330357dcb29356cb10692c5bfe7c"} Jul 13 22:14:31.901819 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:31.901800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8dbnr" event={"ID":"ea1fae88-eb70-4e6d-932d-41c185e374d9","Type":"ContainerStarted","Data":"2b56fbdc2e80973f88deba0e19e1a8fb8463ba0d0ee75d63c2c0870003020dde"} Jul 13 22:14:37.922246 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.921852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8dbnr" event={"ID":"ea1fae88-eb70-4e6d-932d-41c185e374d9","Type":"ContainerStarted","Data":"d20a1c41731bf7ae0dc6c4828ad7369441925c11e20ee42b69cdaa1a4d518061"} Jul 13 22:14:37.923304 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.923277 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcgvn" event={"ID":"ffe05c71-8f75-400c-8404-a50cf7807e14","Type":"ContainerStarted","Data":"e975064f5aea54e7e64baae3c84706eab07e0cdbdbfb89af00d5bba0778e3329"} Jul 13 22:14:37.924529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.924507 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" event={"ID":"26198bc0-fa80-45d6-9c06-b3ee5cd4d22e","Type":"ContainerStarted","Data":"6f7b69af77b75ce7239980d0600dd5786e0022b1246594ca9bd9cefc32e6326b"} Jul 13 22:14:37.924587 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.924558 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" Jul 13 22:14:37.926205 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.926182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8pbt" event={"ID":"5d3bcba8-18a5-411e-a721-9b54cb862ff7","Type":"ContainerStarted","Data":"3887e319eab0191dad6def314d3a0bd37ca7c6267ab741121b4127e9446863de"} Jul 13 22:14:37.926333 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.926219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r8pbt" event={"ID":"5d3bcba8-18a5-411e-a721-9b54cb862ff7","Type":"ContainerStarted","Data":"566559fe0f2537e535bd749c3b2c42f3d9e6c7ee94b01fd12fa3c97b91510f96"} Jul 13 22:14:37.926400 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.926331 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:37.929614 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.929598 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" Jul 13 22:14:37.948451 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.948385 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8dbnr" podStartSLOduration=1.824059951 podStartE2EDuration="7.948369752s" totalImagesPullingTime="6.124309801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:37.947787198 +0000 UTC m=+55.961783978" watchObservedRunningTime="2026-07-13 22:14:37.948369752 +0000 UTC m=+55.962366509" Jul 13 22:14:37.974435 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.974375 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9jkhn" podStartSLOduration=1.047119352 podStartE2EDuration="6.974358738s" totalImagesPullingTime="5.927239386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:37.973760389 +0000 UTC m=+55.987757170" watchObservedRunningTime="2026-07-13 22:14:37.974358738 +0000 UTC m=+55.988355514" Jul 13 22:14:37.995554 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:37.995484 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r8pbt" podStartSLOduration=1.914155442 podStartE2EDuration="7.995464744s" totalImagesPullingTime="6.081309302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:37.994909822 +0000 UTC m=+56.008906602" watchObservedRunningTime="2026-07-13 22:14:37.995464744 +0000 UTC m=+56.009461524" Jul 13 22:14:38.933009 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:38.932977 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcgvn" event={"ID":"ffe05c71-8f75-400c-8404-a50cf7807e14","Type":"ContainerStarted","Data":"70cca3b0768fabb232a96ac0a1c09ceabe808bdc12f7db8e9bde4070fa01cfa9"} Jul 13 22:14:39.094193 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.094154 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-lwxnd"] Jul 13 22:14:39.096331 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.096301 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.099110 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.099088 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 22:14:39.100287 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.100266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 13 22:14:39.100445 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.100406 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 22:14:39.100574 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.100554 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 13 22:14:39.100688 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.100675 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 22:14:39.100759 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.100737 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2g27b\"" Jul 13 22:14:39.109549 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.109389 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-lwxnd"] Jul 13 22:14:39.128914 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.128886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33986edf-492a-444c-b32b-759898fd4d9f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.129061 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.128932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33986edf-492a-444c-b32b-759898fd4d9f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.129061 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.128963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/33986edf-492a-444c-b32b-759898fd4d9f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.129061 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.129051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5glg6\" (UniqueName: \"kubernetes.io/projected/33986edf-492a-444c-b32b-759898fd4d9f-kube-api-access-5glg6\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.230045 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.229952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5glg6\" (UniqueName: \"kubernetes.io/projected/33986edf-492a-444c-b32b-759898fd4d9f-kube-api-access-5glg6\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.230045 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.230019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33986edf-492a-444c-b32b-759898fd4d9f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.230268 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.230068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33986edf-492a-444c-b32b-759898fd4d9f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.230268 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.230099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/33986edf-492a-444c-b32b-759898fd4d9f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.230268 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:39.230215 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 13 22:14:39.230443 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:39.230275 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33986edf-492a-444c-b32b-759898fd4d9f-prometheus-operator-tls podName:33986edf-492a-444c-b32b-759898fd4d9f nodeName:}" failed. No retries permitted until 2026-07-13 22:14:39.730260202 +0000 UTC m=+57.744256960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/33986edf-492a-444c-b32b-759898fd4d9f-prometheus-operator-tls") pod "prometheus-operator-64785b6675-lwxnd" (UID: "33986edf-492a-444c-b32b-759898fd4d9f") : secret "prometheus-operator-tls" not found Jul 13 22:14:39.230775 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.230754 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33986edf-492a-444c-b32b-759898fd4d9f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.234996 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.234950 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33986edf-492a-444c-b32b-759898fd4d9f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.238998 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.238976 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5glg6\" (UniqueName: \"kubernetes.io/projected/33986edf-492a-444c-b32b-759898fd4d9f-kube-api-access-5glg6\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.734212 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.734179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/33986edf-492a-444c-b32b-759898fd4d9f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:39.736989 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:39.736961 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/33986edf-492a-444c-b32b-759898fd4d9f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-lwxnd\" (UID: \"33986edf-492a-444c-b32b-759898fd4d9f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:40.008333 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:40.008246 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" Jul 13 22:14:40.805630 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:40.805596 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-lwxnd"] Jul 13 22:14:40.808238 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:40.808211 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33986edf_492a_444c_b32b_759898fd4d9f.slice/crio-7952d0c58f01c13af4c8a734c304e3c45d4affeb3729c0c2357cc9c3c9ca77d0 WatchSource:0}: Error finding container 7952d0c58f01c13af4c8a734c304e3c45d4affeb3729c0c2357cc9c3c9ca77d0: Status 404 returned error can't find the container with id 7952d0c58f01c13af4c8a734c304e3c45d4affeb3729c0c2357cc9c3c9ca77d0 Jul 13 22:14:40.941184 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:40.941097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fcgvn" event={"ID":"ffe05c71-8f75-400c-8404-a50cf7807e14","Type":"ContainerStarted","Data":"7cd66c731b47e708cc5643afcc254aa3af1ef6a1b86a23bbd125d361c961f3de"} Jul 13 22:14:40.942158 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:40.942132 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" event={"ID":"33986edf-492a-444c-b32b-759898fd4d9f","Type":"ContainerStarted","Data":"7952d0c58f01c13af4c8a734c304e3c45d4affeb3729c0c2357cc9c3c9ca77d0"} Jul 13 22:14:40.962990 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:40.962939 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fcgvn" podStartSLOduration=1.872542724 podStartE2EDuration="10.962921504s" totalImagesPullingTime="9.09037878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:14:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:40.961844925 +0000 UTC m=+58.975841705" watchObservedRunningTime="2026-07-13 22:14:40.962921504 +0000 UTC m=+58.976918289" Jul 13 22:14:42.950999 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:42.950954 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" event={"ID":"33986edf-492a-444c-b32b-759898fd4d9f","Type":"ContainerStarted","Data":"bcb30bff91463aee6dd8bb905d52400b5f557dd957ea12207b175fb1a8ed17bc"} Jul 13 22:14:42.951501 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:42.951040 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" event={"ID":"33986edf-492a-444c-b32b-759898fd4d9f","Type":"ContainerStarted","Data":"eeed6e287e2dd4c56d3297866a92ce42a9d98d461666ee0586ad28bd9573b2b1"} Jul 13 22:14:42.973859 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:42.973767 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-lwxnd" podStartSLOduration=2.075707696 podStartE2EDuration="3.973750875s" totalImagesPullingTime="1.898043179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:42.973119195 +0000 UTC m=+60.987115975" watchObservedRunningTime="2026-07-13 22:14:42.973750875 +0000 UTC m=+60.987747697" Jul 13 22:14:43.855726 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:43.855700 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9f5l" Jul 13 22:14:44.506595 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.506562 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5"] Jul 13 22:14:44.508620 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.508604 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.511093 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.511071 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 13 22:14:44.511378 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.511361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 13 22:14:44.511492 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.511414 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-25fm9\"" Jul 13 22:14:44.526215 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.526192 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5"] Jul 13 22:14:44.540601 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.540576 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nck77"] Jul 13 22:14:44.542531 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.542512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.545216 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.545188 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 22:14:44.545636 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.545612 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 22:14:44.545875 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.545853 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 22:14:44.545974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.545878 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q65jt\"" Jul 13 22:14:44.572070 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-sys\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.572070 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-root\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.572295 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-accelerators-collector-config\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.572295 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.572295 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmtgg\" (UniqueName: \"kubernetes.io/projected/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-kube-api-access-mmtgg\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.572295 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.572532 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c9v2\" (UniqueName: \"kubernetes.io/projected/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-kube-api-access-2c9v2\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.572532 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-wtmp\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.572532 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-metrics-client-ca\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.572532 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.572532 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.572532 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-tls\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.572532 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.572501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-textfile\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.598804 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.598769 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h82jw"] Jul 13 22:14:44.600912 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.600896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.603527 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.603505 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 13 22:14:44.603654 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.603565 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 13 22:14:44.604011 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.603964 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dlvnr\"" Jul 13 22:14:44.604097 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.604031 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 13 22:14:44.614766 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.614747 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h82jw"] Jul 13 22:14:44.673110 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-wtmp\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.673110 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-metrics-client-ca\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.673110 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.673110 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-tls\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f587m\" (UniqueName: \"kubernetes.io/projected/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-api-access-f587m\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-textfile\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-wtmp\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8724ae8e-ba69-4a79-a970-3d3921b66da4-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:44.673274 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-sys\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8724ae8e-ba69-4a79-a970-3d3921b66da4-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673339 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-sys\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:44.673348 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-tls podName:0baa30ce-fb22-41fc-b1dc-3bee3612eaea nodeName:}" failed. No retries permitted until 2026-07-13 22:14:45.17332526 +0000 UTC m=+63.187322017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-tls") pod "node-exporter-nck77" (UID: "0baa30ce-fb22-41fc-b1dc-3bee3612eaea") : secret "node-exporter-tls" not found Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:44.673275 2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:44.673407 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-openshift-state-metrics-tls podName:b1c75bbe-9296-476f-ad8c-0a1e03f26c88 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:45.17339158 +0000 UTC m=+63.187388354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-kqxj5" (UID: "b1c75bbe-9296-476f-ad8c-0a1e03f26c88") : secret "openshift-state-metrics-tls" not found Jul 13 22:14:44.673455 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-root\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.673992 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673567 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-root\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.673992 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673979 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-metrics-client-ca\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.674062 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.673484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-accelerators-collector-config\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.674114 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.674089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.674268 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.674172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.674268 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.674234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmtgg\" (UniqueName: \"kubernetes.io/projected/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-kube-api-access-mmtgg\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.674268 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.674268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.674562 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.674540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c9v2\" (UniqueName: \"kubernetes.io/projected/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-kube-api-access-2c9v2\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.674801 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.674780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.674876 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.674813 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-textfile\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.674876 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.674865 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-accelerators-collector-config\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.676022 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.675502 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.678861 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.676597 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.679596 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.679568 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.682511 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.682491 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmtgg\" (UniqueName: \"kubernetes.io/projected/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-kube-api-access-mmtgg\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:44.687253 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.687231 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c9v2\" (UniqueName: \"kubernetes.io/projected/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-kube-api-access-2c9v2\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:44.776122 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.776087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8724ae8e-ba69-4a79-a970-3d3921b66da4-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.776122 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.776128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.776329 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.776298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.776369 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.776362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.776501 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:44.776488 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 13 22:14:44.776561 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:44.776549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-tls podName:8724ae8e-ba69-4a79-a970-3d3921b66da4 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:45.276531045 +0000 UTC m=+63.290527803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-h82jw" (UID: "8724ae8e-ba69-4a79-a970-3d3921b66da4") : secret "kube-state-metrics-tls" not found Jul 13 22:14:44.776609 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.776566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f587m\" (UniqueName: \"kubernetes.io/projected/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-api-access-f587m\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.776609 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.776594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8724ae8e-ba69-4a79-a970-3d3921b66da4-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.776703 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.776631 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8724ae8e-ba69-4a79-a970-3d3921b66da4-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.777037 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.777014 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.777252 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.777235 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8724ae8e-ba69-4a79-a970-3d3921b66da4-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.778809 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.778791 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:44.784974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:44.784955 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f587m\" (UniqueName: \"kubernetes.io/projected/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-api-access-f587m\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:45.180794 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.180761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:45.180794 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.180796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-tls\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:45.183178 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.183154 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0baa30ce-fb22-41fc-b1dc-3bee3612eaea-node-exporter-tls\") pod \"node-exporter-nck77\" (UID: \"0baa30ce-fb22-41fc-b1dc-3bee3612eaea\") " pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:45.183290 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.183198 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1c75bbe-9296-476f-ad8c-0a1e03f26c88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-kqxj5\" (UID: \"b1c75bbe-9296-476f-ad8c-0a1e03f26c88\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:45.281506 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.281453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:45.283855 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.283831 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8724ae8e-ba69-4a79-a970-3d3921b66da4-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h82jw\" (UID: \"8724ae8e-ba69-4a79-a970-3d3921b66da4\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:45.417204 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.417173 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" Jul 13 22:14:45.451327 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.451236 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nck77" Jul 13 22:14:45.462271 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:45.462242 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0baa30ce_fb22_41fc_b1dc_3bee3612eaea.slice/crio-90b338f7991c7ec67c16d1586d8c5e305d191f7cba8ba5b4ba94c22bc38f27c7 WatchSource:0}: Error finding container 90b338f7991c7ec67c16d1586d8c5e305d191f7cba8ba5b4ba94c22bc38f27c7: Status 404 returned error can't find the container with id 90b338f7991c7ec67c16d1586d8c5e305d191f7cba8ba5b4ba94c22bc38f27c7 Jul 13 22:14:45.509753 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.509723 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" Jul 13 22:14:45.557499 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.557468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5"] Jul 13 22:14:45.561019 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:45.560995 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c75bbe_9296_476f_ad8c_0a1e03f26c88.slice/crio-dd3ee5327bb4d27db150b548089fe0ee1c097e1798807f2400b0255ee289780f WatchSource:0}: Error finding container dd3ee5327bb4d27db150b548089fe0ee1c097e1798807f2400b0255ee289780f: Status 404 returned error can't find the container with id dd3ee5327bb4d27db150b548089fe0ee1c097e1798807f2400b0255ee289780f Jul 13 22:14:45.589392 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.589365 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 22:14:45.592521 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.592502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.596190 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.596169 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 22:14:45.596351 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.596339 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 22:14:45.596496 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.596484 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 22:14:45.596606 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.596596 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 22:14:45.596852 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.596839 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 22:14:45.597217 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.597198 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 22:14:45.597278 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.597266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 22:14:45.598277 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.597874 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h7lsk\"" Jul 13 22:14:45.598277 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.597896 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 22:14:45.598277 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.598090 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 22:14:45.613166 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.613141 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 22:14:45.668510 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.668483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h82jw"] Jul 13 22:14:45.671779 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:45.671752 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8724ae8e_ba69_4a79_a970_3d3921b66da4.slice/crio-b3fbc29dc7f06c8076abee7d1a4cf3748c1e87f1cfc57b6b11a1399b18538b43 WatchSource:0}: Error finding container b3fbc29dc7f06c8076abee7d1a4cf3748c1e87f1cfc57b6b11a1399b18538b43: Status 404 returned error can't find the container with id b3fbc29dc7f06c8076abee7d1a4cf3748c1e87f1cfc57b6b11a1399b18538b43 Jul 13 22:14:45.685499 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d6cfb0c-2a15-470f-aed2-a6578c11260d-config-out\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685616 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685616 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685699 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685699 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6cfb0c-2a15-470f-aed2-a6578c11260d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685784 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d6cfb0c-2a15-470f-aed2-a6578c11260d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685784 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-web-config\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685784 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685948 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d6cfb0c-2a15-470f-aed2-a6578c11260d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685948 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s465c\" (UniqueName: \"kubernetes.io/projected/0d6cfb0c-2a15-470f-aed2-a6578c11260d-kube-api-access-s465c\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.685948 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.686111 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.685993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.686111 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.686058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d6cfb0c-2a15-470f-aed2-a6578c11260d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.786971 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.786935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-web-config\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.786971 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.786975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.787222 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.786993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d6cfb0c-2a15-470f-aed2-a6578c11260d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.787222 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s465c\" (UniqueName: \"kubernetes.io/projected/0d6cfb0c-2a15-470f-aed2-a6578c11260d-kube-api-access-s465c\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.787222 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.787222 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.787222 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d6cfb0c-2a15-470f-aed2-a6578c11260d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.787534 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d6cfb0c-2a15-470f-aed2-a6578c11260d-config-out\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.787534 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.787534 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.787685 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:45.787670 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 13 22:14:45.788550 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.788550 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6cfb0c-2a15-470f-aed2-a6578c11260d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.788550 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.787953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d6cfb0c-2a15-470f-aed2-a6578c11260d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.788550 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:45.788025 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-main-tls podName:0d6cfb0c-2a15-470f-aed2-a6578c11260d nodeName:}" failed. No retries permitted until 2026-07-13 22:14:46.288002733 +0000 UTC m=+64.301999490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0d6cfb0c-2a15-470f-aed2-a6578c11260d") : secret "alertmanager-main-tls" not found Jul 13 22:14:45.788550 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.788294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d6cfb0c-2a15-470f-aed2-a6578c11260d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.788550 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.788543 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d6cfb0c-2a15-470f-aed2-a6578c11260d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.789170 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.788901 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6cfb0c-2a15-470f-aed2-a6578c11260d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.790006 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.789982 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d6cfb0c-2a15-470f-aed2-a6578c11260d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.790350 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.790284 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.790679 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.790653 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.790834 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.790816 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-web-config\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.790954 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.790935 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d6cfb0c-2a15-470f-aed2-a6578c11260d-config-out\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.791741 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.791714 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.791741 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.791729 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.792028 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.792012 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.795697 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.795678 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s465c\" (UniqueName: \"kubernetes.io/projected/0d6cfb0c-2a15-470f-aed2-a6578c11260d-kube-api-access-s465c\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:45.962332 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.962238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" event={"ID":"b1c75bbe-9296-476f-ad8c-0a1e03f26c88","Type":"ContainerStarted","Data":"ec5110971c16aa69484b68230306ced6b64e1e32a43431571c0cfdc6fc3f66c9"} Jul 13 22:14:45.962332 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.962299 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" event={"ID":"b1c75bbe-9296-476f-ad8c-0a1e03f26c88","Type":"ContainerStarted","Data":"afc9a2f60a1ef1494fe18ddbf2e65ff532e7bce07de1708834943c727152d85b"} Jul 13 22:14:45.962332 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.962321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" event={"ID":"b1c75bbe-9296-476f-ad8c-0a1e03f26c88","Type":"ContainerStarted","Data":"dd3ee5327bb4d27db150b548089fe0ee1c097e1798807f2400b0255ee289780f"} Jul 13 22:14:45.963315 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.963288 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" event={"ID":"8724ae8e-ba69-4a79-a970-3d3921b66da4","Type":"ContainerStarted","Data":"b3fbc29dc7f06c8076abee7d1a4cf3748c1e87f1cfc57b6b11a1399b18538b43"} Jul 13 22:14:45.964381 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:45.964359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nck77" event={"ID":"0baa30ce-fb22-41fc-b1dc-3bee3612eaea","Type":"ContainerStarted","Data":"90b338f7991c7ec67c16d1586d8c5e305d191f7cba8ba5b4ba94c22bc38f27c7"} Jul 13 22:14:46.293276 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:46.293185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:46.296531 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:46.296499 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d6cfb0c-2a15-470f-aed2-a6578c11260d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d6cfb0c-2a15-470f-aed2-a6578c11260d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:46.510569 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:46.510531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 22:14:47.309484 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.309333 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 22:14:47.314228 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:47.314195 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6cfb0c_2a15_470f_aed2_a6578c11260d.slice/crio-46755b412d7650467225fec93c412baf4b7f9823a9dc46afcf5a0c8d9aaaa8c9 WatchSource:0}: Error finding container 46755b412d7650467225fec93c412baf4b7f9823a9dc46afcf5a0c8d9aaaa8c9: Status 404 returned error can't find the container with id 46755b412d7650467225fec93c412baf4b7f9823a9dc46afcf5a0c8d9aaaa8c9 Jul 13 22:14:47.577489 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.577462 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bd4556dcd-pflwr"] Jul 13 22:14:47.579930 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.579911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.582920 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.582882 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 13 22:14:47.583058 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.582932 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-79hgx\"" Jul 13 22:14:47.583129 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.583056 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 13 22:14:47.583212 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.583194 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 13 22:14:47.583309 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.583285 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5o1st4dfqtug\"" Jul 13 22:14:47.583532 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.583520 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 13 22:14:47.583801 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.583788 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 13 22:14:47.598688 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.598659 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bd4556dcd-pflwr"] Jul 13 22:14:47.707955 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.707866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.707955 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.707899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.707955 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.707929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47wj8\" (UniqueName: \"kubernetes.io/projected/a6105de6-f7ad-42d6-a379-11daa8902783-kube-api-access-47wj8\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.707955 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.707952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.708226 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.708066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-tls\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.708226 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.708097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-grpc-tls\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.708226 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.708128 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.708226 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.708172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6105de6-f7ad-42d6-a379-11daa8902783-metrics-client-ca\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.808591 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.808558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6105de6-f7ad-42d6-a379-11daa8902783-metrics-client-ca\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.808591 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.808593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.808786 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.808618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.808786 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.808644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47wj8\" (UniqueName: \"kubernetes.io/projected/a6105de6-f7ad-42d6-a379-11daa8902783-kube-api-access-47wj8\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.808786 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.808662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.808786 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.808756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-tls\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.808786 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.808779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-grpc-tls\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.809014 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.808810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.809444 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.809385 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6105de6-f7ad-42d6-a379-11daa8902783-metrics-client-ca\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.811351 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.811322 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.811673 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.811648 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-grpc-tls\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.811860 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.811838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-tls\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.811944 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.811862 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.811944 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.811913 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.812048 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.811997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6105de6-f7ad-42d6-a379-11daa8902783-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.821145 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.821120 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47wj8\" (UniqueName: \"kubernetes.io/projected/a6105de6-f7ad-42d6-a379-11daa8902783-kube-api-access-47wj8\") pod \"thanos-querier-6bd4556dcd-pflwr\" (UID: \"a6105de6-f7ad-42d6-a379-11daa8902783\") " pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.889415 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.889382 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:47.936151 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.936122 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r8pbt" Jul 13 22:14:47.977497 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.977387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" event={"ID":"8724ae8e-ba69-4a79-a970-3d3921b66da4","Type":"ContainerStarted","Data":"3aed727700dfccf4dcceb362e2c8af765d9130f39464e794217fd916019318a2"} Jul 13 22:14:47.977497 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.977479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" event={"ID":"8724ae8e-ba69-4a79-a970-3d3921b66da4","Type":"ContainerStarted","Data":"798fac96a24c44ed40d97d3e0c13034f226d6aa99cbfda5c010079e137026503"} Jul 13 22:14:47.977714 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.977509 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" event={"ID":"8724ae8e-ba69-4a79-a970-3d3921b66da4","Type":"ContainerStarted","Data":"fc00f6d8cc3c77b58fcc02f09b282371dfd6d5aaa7a21fc43ace5e984495040c"} Jul 13 22:14:47.989481 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.989451 2577 generic.go:356] "Generic (PLEG): container finished" podID="0baa30ce-fb22-41fc-b1dc-3bee3612eaea" containerID="676081fe8ce879ec8d55abd893b77f88601faebf10bf9f3ebb8b2979d3b4dc7e" exitCode=0 Jul 13 22:14:47.989618 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.989581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nck77" event={"ID":"0baa30ce-fb22-41fc-b1dc-3bee3612eaea","Type":"ContainerDied","Data":"676081fe8ce879ec8d55abd893b77f88601faebf10bf9f3ebb8b2979d3b4dc7e"} Jul 13 22:14:47.991466 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:47.991417 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6cfb0c-2a15-470f-aed2-a6578c11260d","Type":"ContainerStarted","Data":"46755b412d7650467225fec93c412baf4b7f9823a9dc46afcf5a0c8d9aaaa8c9"} Jul 13 22:14:48.002190 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.001561 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-h82jw" podStartSLOduration=2.5274232039999998 podStartE2EDuration="4.001539619s" totalImagesPullingTime="1.474116415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:47.996696445 +0000 UTC m=+66.010693226" watchObservedRunningTime="2026-07-13 22:14:48.001539619 +0000 UTC m=+66.015536392" Jul 13 22:14:48.003871 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.003790 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" event={"ID":"b1c75bbe-9296-476f-ad8c-0a1e03f26c88","Type":"ContainerStarted","Data":"29aabb0f113a15a6a1425269cc49b45a1bdb50a5bac92e21ad51982a361e7a3f"} Jul 13 22:14:48.040411 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.040337 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-kqxj5" podStartSLOduration=2.623972041 podStartE2EDuration="4.040314121s" totalImagesPullingTime="1.41634208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:48.038778178 +0000 UTC m=+66.052774959" watchObservedRunningTime="2026-07-13 22:14:48.040314121 +0000 UTC m=+66.054310902" Jul 13 22:14:48.065775 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.064883 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bd4556dcd-pflwr"] Jul 13 22:14:48.315385 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.315349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:48.315385 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.315389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:48.322328 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.322305 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 22:14:48.322533 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.322514 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 22:14:48.328511 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.328491 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fbb4560a-0092-4378-b80b-d2d29109b1c8-original-pull-secret\") pod \"global-pull-secret-syncer-n9s5l\" (UID: \"fbb4560a-0092-4378-b80b-d2d29109b1c8\") " pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:48.328690 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.328672 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/389f6223-7e84-4f59-9168-e6229907c56d-metrics-certs\") pod \"network-metrics-daemon-nkrpc\" (UID: \"389f6223-7e84-4f59-9168-e6229907c56d\") " pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:48.374300 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.374265 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jtd57\"" Jul 13 22:14:48.382816 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.382797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkrpc" Jul 13 22:14:48.383980 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.383961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9s5l" Jul 13 22:14:48.416214 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.416162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:48.418931 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.418907 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 22:14:48.429364 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.429337 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 22:14:48.440395 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.440360 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2bpf\" (UniqueName: \"kubernetes.io/projected/844b435c-ca82-43b5-9918-8d7533f943cd-kube-api-access-g2bpf\") pod \"network-check-target-7fcsw\" (UID: \"844b435c-ca82-43b5-9918-8d7533f943cd\") " pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:48.682556 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.682476 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpxwn\"" Jul 13 22:14:48.690833 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.690808 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:48.836670 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.836607 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nkrpc"] Jul 13 22:14:48.840410 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:48.840371 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389f6223_7e84_4f59_9168_e6229907c56d.slice/crio-9a722ebeb9dcc109ba11bb0fc4adbae98392796ef9b867ed735cbe0647d81b79 WatchSource:0}: Error finding container 9a722ebeb9dcc109ba11bb0fc4adbae98392796ef9b867ed735cbe0647d81b79: Status 404 returned error can't find the container with id 9a722ebeb9dcc109ba11bb0fc4adbae98392796ef9b867ed735cbe0647d81b79 Jul 13 22:14:48.855102 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.855078 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n9s5l"] Jul 13 22:14:48.858219 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:48.858193 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb4560a_0092_4378_b80b_d2d29109b1c8.slice/crio-3fc01ad5374a9b41fdd6fd637b89fa66ab8c712daea474b72836eab08b50f841 WatchSource:0}: Error finding container 3fc01ad5374a9b41fdd6fd637b89fa66ab8c712daea474b72836eab08b50f841: Status 404 returned error can't find the container with id 3fc01ad5374a9b41fdd6fd637b89fa66ab8c712daea474b72836eab08b50f841 Jul 13 22:14:48.877533 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.877504 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7fcsw"] Jul 13 22:14:48.881032 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:48.881005 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844b435c_ca82_43b5_9918_8d7533f943cd.slice/crio-e5c11f1b118b7556192638f7fd3888b640cce8ac34c926a6a06938d7b94eab94 WatchSource:0}: Error finding container e5c11f1b118b7556192638f7fd3888b640cce8ac34c926a6a06938d7b94eab94: Status 404 returned error can't find the container with id e5c11f1b118b7556192638f7fd3888b640cce8ac34c926a6a06938d7b94eab94 Jul 13 22:14:48.896979 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.896957 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-84f9f7675-496pp"] Jul 13 22:14:48.913546 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.913520 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:48.914692 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.914637 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84f9f7675-496pp"] Jul 13 22:14:48.916463 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.916417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 13 22:14:48.916463 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.916417 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 22:14:48.916610 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.916495 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5495rifoucs29\"" Jul 13 22:14:48.916610 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.916416 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-w5dsw\"" Jul 13 22:14:48.916742 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.916636 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 13 22:14:48.917376 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:48.917354 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 13 22:14:49.009271 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.009186 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nck77" event={"ID":"0baa30ce-fb22-41fc-b1dc-3bee3612eaea","Type":"ContainerStarted","Data":"60156c120e378aebf647cf4a378e529d8b2e32c3b369a51ca6a29750437b192e"} Jul 13 22:14:49.009271 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.009246 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nck77" event={"ID":"0baa30ce-fb22-41fc-b1dc-3bee3612eaea","Type":"ContainerStarted","Data":"86b94d42d4151812d188c50921fa652a7be652a03a8918f754ae0db4329f0a1b"} Jul 13 22:14:49.010343 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.010322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7fcsw" event={"ID":"844b435c-ca82-43b5-9918-8d7533f943cd","Type":"ContainerStarted","Data":"e5c11f1b118b7556192638f7fd3888b640cce8ac34c926a6a06938d7b94eab94"} Jul 13 22:14:49.011273 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.011253 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n9s5l" event={"ID":"fbb4560a-0092-4378-b80b-d2d29109b1c8","Type":"ContainerStarted","Data":"3fc01ad5374a9b41fdd6fd637b89fa66ab8c712daea474b72836eab08b50f841"} Jul 13 22:14:49.012326 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.012275 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nkrpc" event={"ID":"389f6223-7e84-4f59-9168-e6229907c56d","Type":"ContainerStarted","Data":"9a722ebeb9dcc109ba11bb0fc4adbae98392796ef9b867ed735cbe0647d81b79"} Jul 13 22:14:49.013373 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.013353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" event={"ID":"a6105de6-f7ad-42d6-a379-11daa8902783","Type":"ContainerStarted","Data":"97188c17a47d16299969551e5f06bafdb6c25aa7b1086b9d82450dad3528ae97"} Jul 13 22:14:49.021250 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.021229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07efcc47-ed76-4efe-81a2-c062cce475ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.021338 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.021260 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07efcc47-ed76-4efe-81a2-c062cce475ea-metrics-server-audit-profiles\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.021338 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.021291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07efcc47-ed76-4efe-81a2-c062cce475ea-secret-metrics-server-client-certs\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.021338 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.021316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68868\" (UniqueName: \"kubernetes.io/projected/07efcc47-ed76-4efe-81a2-c062cce475ea-kube-api-access-68868\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.021489 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.021402 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07efcc47-ed76-4efe-81a2-c062cce475ea-audit-log\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.021530 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.021511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07efcc47-ed76-4efe-81a2-c062cce475ea-client-ca-bundle\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.021577 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.021541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07efcc47-ed76-4efe-81a2-c062cce475ea-secret-metrics-server-tls\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.028734 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.028322 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nck77" podStartSLOduration=3.2459736550000002 podStartE2EDuration="5.028307482s" totalImagesPullingTime="1.677871025s" totalInitContainerRuntime="104.462802ms" isStatefulPod=true podCreationTimestamp="2026-07-13 22:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:49.027404893 +0000 UTC m=+67.041401672" watchObservedRunningTime="2026-07-13 22:14:49.028307482 +0000 UTC m=+67.042304261" Jul 13 22:14:49.123001 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.122965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07efcc47-ed76-4efe-81a2-c062cce475ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.123189 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.123011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07efcc47-ed76-4efe-81a2-c062cce475ea-metrics-server-audit-profiles\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.123189 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.123049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07efcc47-ed76-4efe-81a2-c062cce475ea-secret-metrics-server-client-certs\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.123189 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.123108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68868\" (UniqueName: \"kubernetes.io/projected/07efcc47-ed76-4efe-81a2-c062cce475ea-kube-api-access-68868\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.123189 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.123177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07efcc47-ed76-4efe-81a2-c062cce475ea-audit-log\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.123406 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.123335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07efcc47-ed76-4efe-81a2-c062cce475ea-client-ca-bundle\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.123406 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.123397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07efcc47-ed76-4efe-81a2-c062cce475ea-secret-metrics-server-tls\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.124272 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.124238 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07efcc47-ed76-4efe-81a2-c062cce475ea-metrics-server-audit-profiles\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.124757 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.124735 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07efcc47-ed76-4efe-81a2-c062cce475ea-audit-log\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.125274 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.125232 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07efcc47-ed76-4efe-81a2-c062cce475ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.126147 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.126123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07efcc47-ed76-4efe-81a2-c062cce475ea-secret-metrics-server-client-certs\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.127339 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.127305 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07efcc47-ed76-4efe-81a2-c062cce475ea-secret-metrics-server-tls\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.127640 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.127615 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07efcc47-ed76-4efe-81a2-c062cce475ea-client-ca-bundle\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.132438 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.132408 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68868\" (UniqueName: \"kubernetes.io/projected/07efcc47-ed76-4efe-81a2-c062cce475ea-kube-api-access-68868\") pod \"metrics-server-84f9f7675-496pp\" (UID: \"07efcc47-ed76-4efe-81a2-c062cce475ea\") " pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.224160 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.223935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:14:49.246295 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.246264 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-pm264"] Jul 13 22:14:49.280489 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.279951 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69fbb9ff8b-dxbrq"] Jul 13 22:14:49.284409 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.283603 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:49.287448 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.286557 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rwtrc\"" Jul 13 22:14:49.287448 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.286852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 13 22:14:49.301733 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.301700 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-pm264"] Jul 13 22:14:49.301870 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.301746 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fbb9ff8b-dxbrq"] Jul 13 22:14:49.301870 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.301851 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.304712 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.304683 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lvv74\"" Jul 13 22:14:49.305349 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.305222 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 22:14:49.305349 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.305338 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 22:14:49.305626 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.305375 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 22:14:49.305626 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.305510 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 22:14:49.306109 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.306091 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 22:14:49.306494 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.306479 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 22:14:49.306778 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.306762 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 22:14:49.317836 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.317809 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 22:14:49.326274 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.326242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnwk6\" (UniqueName: \"kubernetes.io/projected/cc72a519-22a1-4ef6-b230-fd3608f5133e-kube-api-access-cnwk6\") pod \"monitoring-plugin-5f68df7f58-pm264\" (UID: \"cc72a519-22a1-4ef6-b230-fd3608f5133e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:49.326414 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.326306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc72a519-22a1-4ef6-b230-fd3608f5133e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-pm264\" (UID: \"cc72a519-22a1-4ef6-b230-fd3608f5133e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:49.413636 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.413604 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84f9f7675-496pp"] Jul 13 22:14:49.417662 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:49.417595 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07efcc47_ed76_4efe_81a2_c062cce475ea.slice/crio-89f5c89b8b7920eebb838e6bc87d8899c2572da41b6b0c143ba0c1c196c9a0ad WatchSource:0}: Error finding container 89f5c89b8b7920eebb838e6bc87d8899c2572da41b6b0c143ba0c1c196c9a0ad: Status 404 returned error can't find the container with id 89f5c89b8b7920eebb838e6bc87d8899c2572da41b6b0c143ba0c1c196c9a0ad Jul 13 22:14:49.426905 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.426880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnwk6\" (UniqueName: \"kubernetes.io/projected/cc72a519-22a1-4ef6-b230-fd3608f5133e-kube-api-access-cnwk6\") pod \"monitoring-plugin-5f68df7f58-pm264\" (UID: \"cc72a519-22a1-4ef6-b230-fd3608f5133e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:49.427031 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.426917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc72a519-22a1-4ef6-b230-fd3608f5133e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-pm264\" (UID: \"cc72a519-22a1-4ef6-b230-fd3608f5133e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:49.427031 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.426946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-service-ca\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.427031 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.426978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-trusted-ca-bundle\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.427031 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.427008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-config\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.427235 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.427058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-oauth-config\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.427235 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.427098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-serving-cert\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.427235 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.427122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-oauth-serving-cert\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.427235 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.427163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z562v\" (UniqueName: \"kubernetes.io/projected/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-kube-api-access-z562v\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.427566 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:49.427548 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 13 22:14:49.427657 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:14:49.427622 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc72a519-22a1-4ef6-b230-fd3608f5133e-monitoring-plugin-cert podName:cc72a519-22a1-4ef6-b230-fd3608f5133e nodeName:}" failed. No retries permitted until 2026-07-13 22:14:49.927599487 +0000 UTC m=+67.941596276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cc72a519-22a1-4ef6-b230-fd3608f5133e-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-pm264" (UID: "cc72a519-22a1-4ef6-b230-fd3608f5133e") : secret "monitoring-plugin-cert" not found Jul 13 22:14:49.438088 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.438029 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnwk6\" (UniqueName: \"kubernetes.io/projected/cc72a519-22a1-4ef6-b230-fd3608f5133e-kube-api-access-cnwk6\") pod \"monitoring-plugin-5f68df7f58-pm264\" (UID: \"cc72a519-22a1-4ef6-b230-fd3608f5133e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:49.528460 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.528401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-oauth-config\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.528657 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.528490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-serving-cert\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.528657 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.528517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-oauth-serving-cert\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.528657 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.528553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z562v\" (UniqueName: \"kubernetes.io/projected/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-kube-api-access-z562v\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.528820 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.528671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-service-ca\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.528820 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.528707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-trusted-ca-bundle\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.528820 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.528741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-config\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.529842 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.529697 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-trusted-ca-bundle\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.529952 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.529852 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-oauth-serving-cert\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.530110 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.530081 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-service-ca\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.530206 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.530183 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-config\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.531821 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.531756 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-serving-cert\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.532718 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.532698 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-oauth-config\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.538510 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.538074 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z562v\" (UniqueName: \"kubernetes.io/projected/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-kube-api-access-z562v\") pod \"console-69fbb9ff8b-dxbrq\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.623481 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.623443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:49.824630 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.824594 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fbb9ff8b-dxbrq"] Jul 13 22:14:49.829064 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:49.829017 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6dd48ef_0ce3_4e4f_9fcc_a12fce396e9d.slice/crio-6f11006ef2e266f9abd72d9179a80c4c971f1f9debadff0a9f92847d1b3c08a4 WatchSource:0}: Error finding container 6f11006ef2e266f9abd72d9179a80c4c971f1f9debadff0a9f92847d1b3c08a4: Status 404 returned error can't find the container with id 6f11006ef2e266f9abd72d9179a80c4c971f1f9debadff0a9f92847d1b3c08a4 Jul 13 22:14:49.932036 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.931999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc72a519-22a1-4ef6-b230-fd3608f5133e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-pm264\" (UID: \"cc72a519-22a1-4ef6-b230-fd3608f5133e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:49.935325 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:49.935290 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc72a519-22a1-4ef6-b230-fd3608f5133e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-pm264\" (UID: \"cc72a519-22a1-4ef6-b230-fd3608f5133e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:50.019591 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.019491 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84f9f7675-496pp" event={"ID":"07efcc47-ed76-4efe-81a2-c062cce475ea","Type":"ContainerStarted","Data":"89f5c89b8b7920eebb838e6bc87d8899c2572da41b6b0c143ba0c1c196c9a0ad"} Jul 13 22:14:50.021446 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.021352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fbb9ff8b-dxbrq" event={"ID":"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d","Type":"ContainerStarted","Data":"6f11006ef2e266f9abd72d9179a80c4c971f1f9debadff0a9f92847d1b3c08a4"} Jul 13 22:14:50.024711 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.023450 2577 generic.go:356] "Generic (PLEG): container finished" podID="0d6cfb0c-2a15-470f-aed2-a6578c11260d" containerID="31cb078a4dde5435a18fdaaaf8101726b3a2ff1aa1be4e21b8e82dff553c3f98" exitCode=0 Jul 13 22:14:50.024711 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.024517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6cfb0c-2a15-470f-aed2-a6578c11260d","Type":"ContainerDied","Data":"31cb078a4dde5435a18fdaaaf8101726b3a2ff1aa1be4e21b8e82dff553c3f98"} Jul 13 22:14:50.197297 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.197212 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:50.871833 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.869440 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 22:14:50.874013 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.873988 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.879282 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.878829 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 22:14:50.879282 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.878879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 22:14:50.879282 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.879014 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 22:14:50.879282 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.879121 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 22:14:50.882894 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.880405 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 22:14:50.882894 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.880706 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 22:14:50.882894 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.880973 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7v3je7cls6k8j\"" Jul 13 22:14:50.882894 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.881156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 22:14:50.882894 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.881356 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 22:14:50.887448 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.886994 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hfvjd\"" Jul 13 22:14:50.889119 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.888944 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 22:14:50.890248 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.889732 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 22:14:50.890248 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.889964 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 22:14:50.894075 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.890847 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 22:14:50.894075 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.891195 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 22:14:50.894075 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.893984 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 22:14:50.903692 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.903662 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 22:14:50.940719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.940719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.940982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.940982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.940982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-web-config\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.940982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5lfv\" (UniqueName: \"kubernetes.io/projected/83201afd-d8a7-474a-b9c8-fce5b68234cc-kube-api-access-c5lfv\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.940982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.940982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.940982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.940982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.940934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83201afd-d8a7-474a-b9c8-fce5b68234cc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941721 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-config\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83201afd-d8a7-474a-b9c8-fce5b68234cc-config-out\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:50.941995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:50.941855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043396 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043599 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043599 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83201afd-d8a7-474a-b9c8-fce5b68234cc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043599 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043599 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-config\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043599 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83201afd-d8a7-474a-b9c8-fce5b68234cc-config-out\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043599 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043940 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043940 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043940 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043940 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043940 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043940 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043940 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.043940 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-web-config\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.044319 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5lfv\" (UniqueName: \"kubernetes.io/projected/83201afd-d8a7-474a-b9c8-fce5b68234cc-kube-api-access-c5lfv\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.044319 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.043994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.044319 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.044020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.044319 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.044045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.044319 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.044068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.044638 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.044611 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.045254 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.045225 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.045374 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.045226 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.049884 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.048854 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.049884 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.048947 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83201afd-d8a7-474a-b9c8-fce5b68234cc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.049884 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.048949 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83201afd-d8a7-474a-b9c8-fce5b68234cc-config-out\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.049884 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.049697 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.050761 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.050376 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.050761 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.050590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.050761 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.050607 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-web-config\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.050761 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.050742 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.051120 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.051036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.051353 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.051329 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.051827 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.051803 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-config\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.053272 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.053204 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.053811 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.053541 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.053811 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.053775 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.054121 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.054101 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83201afd-d8a7-474a-b9c8-fce5b68234cc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.055964 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.055622 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83201afd-d8a7-474a-b9c8-fce5b68234cc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.057893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.057872 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5lfv\" (UniqueName: \"kubernetes.io/projected/83201afd-d8a7-474a-b9c8-fce5b68234cc-kube-api-access-c5lfv\") pod \"prometheus-k8s-0\" (UID: \"83201afd-d8a7-474a-b9c8-fce5b68234cc\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:51.204515 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:51.204111 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:14:53.779914 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:53.779885 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-pm264"] Jul 13 22:14:56.192348 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:14:56.192313 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc72a519_22a1_4ef6_b230_fd3608f5133e.slice/crio-71215719036f79e2090192b746217202cb2524585080b112762c5e0d82d88192 WatchSource:0}: Error finding container 71215719036f79e2090192b746217202cb2524585080b112762c5e0d82d88192: Status 404 returned error can't find the container with id 71215719036f79e2090192b746217202cb2524585080b112762c5e0d82d88192 Jul 13 22:14:56.744539 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:56.744400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 22:14:57.077453 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.077360 2577 generic.go:356] "Generic (PLEG): container finished" podID="83201afd-d8a7-474a-b9c8-fce5b68234cc" containerID="8ad963370f1fe768c28be380fc58f9ae0898ca68c1cd29c556e3bd1c78380a3f" exitCode=0 Jul 13 22:14:57.077581 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.077483 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83201afd-d8a7-474a-b9c8-fce5b68234cc","Type":"ContainerDied","Data":"8ad963370f1fe768c28be380fc58f9ae0898ca68c1cd29c556e3bd1c78380a3f"} Jul 13 22:14:57.077581 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.077555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83201afd-d8a7-474a-b9c8-fce5b68234cc","Type":"ContainerStarted","Data":"257e58acb6809467cdc0f8b00b74fbdcacddf15834cfc4d7e92826388d90f289"} Jul 13 22:14:57.080168 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.080142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7fcsw" event={"ID":"844b435c-ca82-43b5-9918-8d7533f943cd","Type":"ContainerStarted","Data":"b53f3a1a0c00931006cb9b07c17575be2f1e8efaa19f07ad2cda5c17b548c0f9"} Jul 13 22:14:57.080861 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.080814 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:14:57.081850 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.081827 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n9s5l" event={"ID":"fbb4560a-0092-4378-b80b-d2d29109b1c8","Type":"ContainerStarted","Data":"0ed9bf34ca52fa655b4e71d421bcb54f5debdecb5cc061c889e6ecf7691c7050"} Jul 13 22:14:57.085869 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.085846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6cfb0c-2a15-470f-aed2-a6578c11260d","Type":"ContainerStarted","Data":"48fae08358de99bd0d48ff3736a970279cbc33a3ff50f4f90fb2b9abdebb25e8"} Jul 13 22:14:57.085966 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.085920 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6cfb0c-2a15-470f-aed2-a6578c11260d","Type":"ContainerStarted","Data":"7b8fa4aa4b514454b063f8ed492b671ffb84c133eb71ea9a7a98e228e11f0580"} Jul 13 22:14:57.085966 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.085960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6cfb0c-2a15-470f-aed2-a6578c11260d","Type":"ContainerStarted","Data":"705955f2aae879180503c3453cb27903e8a3504e6f4c5edf9c75ddd4a19cc08e"} Jul 13 22:14:57.087788 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.087769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nkrpc" event={"ID":"389f6223-7e84-4f59-9168-e6229907c56d","Type":"ContainerStarted","Data":"b355e54e11f85e3c205e0f5d837426098d72ff510513f8ed3c130654728e28e2"} Jul 13 22:14:57.087877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.087813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nkrpc" event={"ID":"389f6223-7e84-4f59-9168-e6229907c56d","Type":"ContainerStarted","Data":"5fe3a06c59191b1405620b86b8488460c0e1d758eccfd31d7fb11da7950d13ab"} Jul 13 22:14:57.088891 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.088872 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" event={"ID":"cc72a519-22a1-4ef6-b230-fd3608f5133e","Type":"ContainerStarted","Data":"71215719036f79e2090192b746217202cb2524585080b112762c5e0d82d88192"} Jul 13 22:14:57.091554 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.091452 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" event={"ID":"a6105de6-f7ad-42d6-a379-11daa8902783","Type":"ContainerStarted","Data":"c360e7fa9571033b44de3301f340bf65ba7943ae69ceb7a1a303fbb3bd451780"} Jul 13 22:14:57.091554 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.091500 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" event={"ID":"a6105de6-f7ad-42d6-a379-11daa8902783","Type":"ContainerStarted","Data":"92e233532705dfe1efcb498d1a81215e518c72c2d4ca459e06d0965f921d3be4"} Jul 13 22:14:57.091554 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.091524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" event={"ID":"a6105de6-f7ad-42d6-a379-11daa8902783","Type":"ContainerStarted","Data":"8c56b8dcd71d54c2d3f3317f527eabd9a27c25734366fe49efd9711b0e0ba480"} Jul 13 22:14:57.093529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.093502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84f9f7675-496pp" event={"ID":"07efcc47-ed76-4efe-81a2-c062cce475ea","Type":"ContainerStarted","Data":"8ff3544339bf7961ce55f68f79a2f4c5a0b4c9569687fc02dec4bf9d96fe42a6"} Jul 13 22:14:57.096144 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.095580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fbb9ff8b-dxbrq" event={"ID":"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d","Type":"ContainerStarted","Data":"4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3"} Jul 13 22:14:57.122464 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.122385 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-84f9f7675-496pp" podStartSLOduration=1.94872191 podStartE2EDuration="9.122365166s" totalImagesPullingTime="7.173643256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:57.121787022 +0000 UTC m=+75.135783802" watchObservedRunningTime="2026-07-13 22:14:57.122365166 +0000 UTC m=+75.136361947" Jul 13 22:14:57.138114 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.138026 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7fcsw" podStartSLOduration=66.427635603 podStartE2EDuration="1m14.138005885s" totalImagesPullingTime="7.710370282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:57.135755657 +0000 UTC m=+75.149752437" watchObservedRunningTime="2026-07-13 22:14:57.138005885 +0000 UTC m=+75.152002665" Jul 13 22:14:57.152372 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.152325 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n9s5l" podStartSLOduration=66.398794857 podStartE2EDuration="1m14.152306622s" totalImagesPullingTime="7.753511765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:57.150378777 +0000 UTC m=+75.164375549" watchObservedRunningTime="2026-07-13 22:14:57.152306622 +0000 UTC m=+75.166303378" Jul 13 22:14:57.168827 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.168774 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nkrpc" podStartSLOduration=66.493920496 podStartE2EDuration="1m14.168751267s" totalImagesPullingTime="7.674830771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:57.166778454 +0000 UTC m=+75.180775235" watchObservedRunningTime="2026-07-13 22:14:57.168751267 +0000 UTC m=+75.182748046" Jul 13 22:14:57.185240 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:57.184799 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69fbb9ff8b-dxbrq" podStartSLOduration=1.407595987 podStartE2EDuration="8.184779716s" totalImagesPullingTime="6.777183729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:57.183616745 +0000 UTC m=+75.197613532" watchObservedRunningTime="2026-07-13 22:14:57.184779716 +0000 UTC m=+75.198776495" Jul 13 22:14:58.104943 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:58.104514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6cfb0c-2a15-470f-aed2-a6578c11260d","Type":"ContainerStarted","Data":"dc59f7124e191ba3769f086a10a025ed7ca2891664850f615100a14325333187"} Jul 13 22:14:58.104943 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:58.104621 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6cfb0c-2a15-470f-aed2-a6578c11260d","Type":"ContainerStarted","Data":"aa31bf442f794b4b1f485c26bf060ea9da181a3af70bc6b8dcf13fb6a92e4107"} Jul 13 22:14:59.111589 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.111551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" event={"ID":"a6105de6-f7ad-42d6-a379-11daa8902783","Type":"ContainerStarted","Data":"a25d7220f0e09195bdf2e327c47ae52b8f35cb7c85c420930401fede95ecf8c9"} Jul 13 22:14:59.112012 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.111613 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" event={"ID":"a6105de6-f7ad-42d6-a379-11daa8902783","Type":"ContainerStarted","Data":"e7a968ea14b78a60a98048448b21f686b53cc313b947b91273024002053ec013"} Jul 13 22:14:59.112012 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.111639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" event={"ID":"a6105de6-f7ad-42d6-a379-11daa8902783","Type":"ContainerStarted","Data":"1d6155c14e250bf7345c32a1d64fae3b25c1f9dc6bbc8348cf2086a536f34cc1"} Jul 13 22:14:59.112012 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.111681 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:14:59.119407 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.119384 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6cfb0c-2a15-470f-aed2-a6578c11260d","Type":"ContainerStarted","Data":"21ec457e836693a34b5c70b0241c1087ee3a715aaf3111966257a7943808c0c5"} Jul 13 22:14:59.120853 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.120824 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" event={"ID":"cc72a519-22a1-4ef6-b230-fd3608f5133e","Type":"ContainerStarted","Data":"05e352a35ca03569a71b58624198f847e9dfdfff3f6fe040e86e7da9498119a4"} Jul 13 22:14:59.120979 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.120957 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:59.125956 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.125936 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" Jul 13 22:14:59.146185 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.146129 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" podStartSLOduration=2.350687991 podStartE2EDuration="12.146109769s" totalImagesPullingTime="9.795421778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:59.144188638 +0000 UTC m=+77.158185417" watchObservedRunningTime="2026-07-13 22:14:59.146109769 +0000 UTC m=+77.160106549" Jul 13 22:14:59.176737 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.176674 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-pm264" podStartSLOduration=8.055017351 podStartE2EDuration="10.176652865s" totalImagesPullingTime="2.121635514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:59.174005727 +0000 UTC m=+77.188002505" watchObservedRunningTime="2026-07-13 22:14:59.176652865 +0000 UTC m=+77.190649648" Jul 13 22:14:59.231053 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.230999 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.702676009 podStartE2EDuration="14.230982462s" totalImagesPullingTime="9.514113033s" totalInitContainerRuntime="14.19342ms" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:59.230379594 +0000 UTC m=+77.244376374" watchObservedRunningTime="2026-07-13 22:14:59.230982462 +0000 UTC m=+77.244979245" Jul 13 22:14:59.623960 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.623921 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:59.624151 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.623988 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:14:59.629380 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:14:59.629352 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:15:00.129593 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:00.129562 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:15:01.138084 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:01.137440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83201afd-d8a7-474a-b9c8-fce5b68234cc","Type":"ContainerStarted","Data":"4a5692ba625f76224c875ffff32d2ad8f1df3736f5b7cfeab993bc3b2bd53945"} Jul 13 22:15:01.138084 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:01.137516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83201afd-d8a7-474a-b9c8-fce5b68234cc","Type":"ContainerStarted","Data":"642e57d091141148c73f24c80c90a1d3021bf78a075c9a1910aabb70c3c65b92"} Jul 13 22:15:01.138084 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:01.137552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83201afd-d8a7-474a-b9c8-fce5b68234cc","Type":"ContainerStarted","Data":"f581952aede5a1eb5ac2351f0ce3dcf89155170da47c382dfbe4f8300c7888db"} Jul 13 22:15:01.138084 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:01.137591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83201afd-d8a7-474a-b9c8-fce5b68234cc","Type":"ContainerStarted","Data":"33a0894d846f58299b439c87ddf65851c79054fe877bfba4354742b5afafe4dc"} Jul 13 22:15:02.143644 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:02.143609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83201afd-d8a7-474a-b9c8-fce5b68234cc","Type":"ContainerStarted","Data":"563feed64e7665ca71b60bf794a4e8827b73d5208df439ff6a4ead95f1cbc55f"} Jul 13 22:15:02.144087 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:02.143725 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83201afd-d8a7-474a-b9c8-fce5b68234cc","Type":"ContainerStarted","Data":"ba8749ed36da76dd40e73e2f2e9c2b3ad836a99121dd11b1f4048f06a84b9a92"} Jul 13 22:15:02.173266 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:02.173202 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.429306712 podStartE2EDuration="12.173180726s" totalImagesPullingTime="3.699270372s" totalInitContainerRuntime="44.603642ms" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:15:02.171300393 +0000 UTC m=+80.185297172" watchObservedRunningTime="2026-07-13 22:15:02.173180726 +0000 UTC m=+80.187177506" Jul 13 22:15:05.132479 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:05.132450 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bd4556dcd-pflwr" Jul 13 22:15:06.205325 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:06.205290 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:15:09.224327 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:09.224284 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:15:09.224764 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:09.224355 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:15:29.123261 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:29.123229 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7fcsw" Jul 13 22:15:29.229640 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:29.229610 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:15:29.233744 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:29.233720 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-84f9f7675-496pp" Jul 13 22:15:51.205042 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:51.205007 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:15:51.225685 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:51.225644 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:15:51.355723 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:15:51.355698 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 22:16:08.913327 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.913290 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67d5ffdd94-65wsn"] Jul 13 22:16:08.916509 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.916486 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:08.919182 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.919156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 13 22:16:08.919310 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.919156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 13 22:16:08.919310 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.919201 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f4zsw\"" Jul 13 22:16:08.919310 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.919201 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 13 22:16:08.919585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.919568 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 13 22:16:08.919656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.919571 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 13 22:16:08.929561 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.929534 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 13 22:16:08.932959 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.932932 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d5ffdd94-65wsn"] Jul 13 22:16:08.957762 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.957732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-secret-telemeter-client\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:08.957762 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.957767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-federate-client-tls\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:08.957974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.957784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-metrics-client-ca\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:08.957974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.957800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-serving-certs-ca-bundle\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:08.957974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.957903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:08.957974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.957938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx2rz\" (UniqueName: \"kubernetes.io/projected/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-kube-api-access-cx2rz\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:08.958106 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.958023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-telemeter-client-tls\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:08.958106 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:08.958088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.059239 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.059197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.059239 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.059239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx2rz\" (UniqueName: \"kubernetes.io/projected/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-kube-api-access-cx2rz\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.059529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.059269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-telemeter-client-tls\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.059529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.059304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.059529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.059326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-secret-telemeter-client\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.059529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.059345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-federate-client-tls\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.059529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.059360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-metrics-client-ca\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.059529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.059376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-serving-certs-ca-bundle\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.060337 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.060301 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-metrics-client-ca\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.060486 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.060301 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-serving-certs-ca-bundle\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.060570 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.060518 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.062015 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.061993 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.062124 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.062086 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-federate-client-tls\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.062398 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.062381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-telemeter-client-tls\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.062490 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.062471 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-secret-telemeter-client\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.067985 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.067962 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx2rz\" (UniqueName: \"kubernetes.io/projected/6e8bb31c-076e-4e84-a40c-b5888e7eaa97-kube-api-access-cx2rz\") pod \"telemeter-client-67d5ffdd94-65wsn\" (UID: \"6e8bb31c-076e-4e84-a40c-b5888e7eaa97\") " pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.230864 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.230788 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" Jul 13 22:16:09.366344 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.366307 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d5ffdd94-65wsn"] Jul 13 22:16:09.369276 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:16:09.369238 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8bb31c_076e_4e84_a40c_b5888e7eaa97.slice/crio-b47dd471b14fda43a32b2f1082e8c34ab19e5a72518094a11967b5be8c2f9028 WatchSource:0}: Error finding container b47dd471b14fda43a32b2f1082e8c34ab19e5a72518094a11967b5be8c2f9028: Status 404 returned error can't find the container with id b47dd471b14fda43a32b2f1082e8c34ab19e5a72518094a11967b5be8c2f9028 Jul 13 22:16:09.415794 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:09.415758 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" event={"ID":"6e8bb31c-076e-4e84-a40c-b5888e7eaa97","Type":"ContainerStarted","Data":"b47dd471b14fda43a32b2f1082e8c34ab19e5a72518094a11967b5be8c2f9028"} Jul 13 22:16:12.429273 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:12.429236 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" event={"ID":"6e8bb31c-076e-4e84-a40c-b5888e7eaa97","Type":"ContainerStarted","Data":"9e0b8e782e11f14457dd83ed423fb4ab00188b3a5b5fcd2331f3c2cd591a4be1"} Jul 13 22:16:12.429803 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:12.429305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" event={"ID":"6e8bb31c-076e-4e84-a40c-b5888e7eaa97","Type":"ContainerStarted","Data":"850698fb840f893405cfe0a6b44363ca7fd76b8708733ff99637a4e3b3fd1092"} Jul 13 22:16:12.429803 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:12.429333 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" event={"ID":"6e8bb31c-076e-4e84-a40c-b5888e7eaa97","Type":"ContainerStarted","Data":"b263b9715318a627f2b63e1c10fa4804d481cd994c2e61a7eb3515c02c307ac6"} Jul 13 22:16:12.453196 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:12.453134 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67d5ffdd94-65wsn" podStartSLOduration=2.03086144 podStartE2EDuration="4.453115135s" totalImagesPullingTime="2.422253695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:16:12.450853794 +0000 UTC m=+150.464850611" watchObservedRunningTime="2026-07-13 22:16:12.453115135 +0000 UTC m=+150.467111914" Jul 13 22:16:30.878749 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:30.878713 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69fbb9ff8b-dxbrq"] Jul 13 22:16:55.899892 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:55.899831 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69fbb9ff8b-dxbrq" podUID="c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" containerName="console" containerID="cri-o://4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3" gracePeriod=15 Jul 13 22:16:56.150656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.150605 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:16:56.196987 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.196952 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z562v\" (UniqueName: \"kubernetes.io/projected/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-kube-api-access-z562v\") pod \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " Jul 13 22:16:56.197167 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197004 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-trusted-ca-bundle\") pod \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " Jul 13 22:16:56.197167 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197042 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-oauth-serving-cert\") pod \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " Jul 13 22:16:56.197279 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197163 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-serving-cert\") pod \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " Jul 13 22:16:56.197279 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197267 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-service-ca\") pod \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " Jul 13 22:16:56.197376 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197336 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-oauth-config\") pod \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " Jul 13 22:16:56.197456 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197388 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-config\") pod \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\" (UID: \"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d\") " Jul 13 22:16:56.197511 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197482 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" (UID: "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:16:56.197557 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197511 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" (UID: "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:16:56.197619 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197594 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-service-ca" (OuterVolumeSpecName: "service-ca") pod "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" (UID: "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:16:56.197751 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197727 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-config" (OuterVolumeSpecName: "console-config") pod "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" (UID: "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:16:56.197928 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197911 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-config\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:16:56.197968 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197934 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-trusted-ca-bundle\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:16:56.197968 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197947 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-oauth-serving-cert\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:16:56.197968 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.197963 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-service-ca\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:16:56.199574 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.199549 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-kube-api-access-z562v" (OuterVolumeSpecName: "kube-api-access-z562v") pod "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" (UID: "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d"). InnerVolumeSpecName "kube-api-access-z562v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:16:56.199693 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.199626 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" (UID: "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:16:56.199819 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.199802 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" (UID: "c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:16:56.298543 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.298504 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-oauth-config\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:16:56.298543 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.298535 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z562v\" (UniqueName: \"kubernetes.io/projected/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-kube-api-access-z562v\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:16:56.298543 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.298545 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d-console-serving-cert\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:16:56.606344 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.606311 2577 generic.go:356] "Generic (PLEG): container finished" podID="c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" containerID="4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3" exitCode=0 Jul 13 22:16:56.606520 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.606376 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fbb9ff8b-dxbrq" Jul 13 22:16:56.606520 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.606399 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fbb9ff8b-dxbrq" event={"ID":"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d","Type":"ContainerDied","Data":"4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3"} Jul 13 22:16:56.606520 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.606471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fbb9ff8b-dxbrq" event={"ID":"c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d","Type":"ContainerDied","Data":"6f11006ef2e266f9abd72d9179a80c4c971f1f9debadff0a9f92847d1b3c08a4"} Jul 13 22:16:56.606520 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.606500 2577 scope.go:117] "RemoveContainer" containerID="4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3" Jul 13 22:16:56.616283 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.614940 2577 scope.go:117] "RemoveContainer" containerID="4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3" Jul 13 22:16:56.616517 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:16:56.616493 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3\": container with ID starting with 4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3 not found: ID does not exist" containerID="4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3" Jul 13 22:16:56.616594 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.616525 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3"} err="failed to get container status \"4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3\": rpc error: code = NotFound desc = could not find container \"4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3\": container with ID starting with 4eb6e4bb4e43b6fbb0e94be0328af1f2c98ba99fa886e3eb03063357d10954e3 not found: ID does not exist" Jul 13 22:16:56.623718 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.623692 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69fbb9ff8b-dxbrq"] Jul 13 22:16:56.627141 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:56.627120 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69fbb9ff8b-dxbrq"] Jul 13 22:16:58.565949 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:16:58.565917 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" path="/var/lib/kubelet/pods/c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d/volumes" Jul 13 22:17:53.861577 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:53.861540 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4qwpw"] Jul 13 22:17:53.861972 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:53.861884 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" containerName="console" Jul 13 22:17:53.861972 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:53.861895 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" containerName="console" Jul 13 22:17:53.862040 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:53.861982 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6dd48ef-0ce3-4e4f-9fcc-a12fce396e9d" containerName="console" Jul 13 22:17:53.865977 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:53.865957 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:17:53.868609 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:53.868589 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 22:17:53.868725 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:53.868609 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 22:17:53.869649 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:53.869636 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r6lvs\"" Jul 13 22:17:53.874163 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:53.874138 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4qwpw"] Jul 13 22:17:54.017281 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:54.017241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/379fefcf-5e69-427c-8f73-82a3c8df2f1d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4qwpw\" (UID: \"379fefcf-5e69-427c-8f73-82a3c8df2f1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:17:54.017499 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:54.017307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcks2\" (UniqueName: \"kubernetes.io/projected/379fefcf-5e69-427c-8f73-82a3c8df2f1d-kube-api-access-rcks2\") pod \"cert-manager-webhook-6486ffd997-4qwpw\" (UID: \"379fefcf-5e69-427c-8f73-82a3c8df2f1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:17:54.118167 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:54.118071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcks2\" (UniqueName: \"kubernetes.io/projected/379fefcf-5e69-427c-8f73-82a3c8df2f1d-kube-api-access-rcks2\") pod \"cert-manager-webhook-6486ffd997-4qwpw\" (UID: \"379fefcf-5e69-427c-8f73-82a3c8df2f1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:17:54.118334 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:54.118201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/379fefcf-5e69-427c-8f73-82a3c8df2f1d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4qwpw\" (UID: \"379fefcf-5e69-427c-8f73-82a3c8df2f1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:17:54.126387 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:54.126355 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/379fefcf-5e69-427c-8f73-82a3c8df2f1d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4qwpw\" (UID: \"379fefcf-5e69-427c-8f73-82a3c8df2f1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:17:54.126523 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:54.126448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcks2\" (UniqueName: \"kubernetes.io/projected/379fefcf-5e69-427c-8f73-82a3c8df2f1d-kube-api-access-rcks2\") pod \"cert-manager-webhook-6486ffd997-4qwpw\" (UID: \"379fefcf-5e69-427c-8f73-82a3c8df2f1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:17:54.187531 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:54.187498 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:17:54.316037 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:54.316007 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4qwpw"] Jul 13 22:17:54.318502 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:17:54.318466 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod379fefcf_5e69_427c_8f73_82a3c8df2f1d.slice/crio-c95ae461937327d0154486aa1225f39062de0f1e9b2d6b65dc9284fb7d265443 WatchSource:0}: Error finding container c95ae461937327d0154486aa1225f39062de0f1e9b2d6b65dc9284fb7d265443: Status 404 returned error can't find the container with id c95ae461937327d0154486aa1225f39062de0f1e9b2d6b65dc9284fb7d265443 Jul 13 22:17:54.832617 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:54.832583 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" event={"ID":"379fefcf-5e69-427c-8f73-82a3c8df2f1d","Type":"ContainerStarted","Data":"c95ae461937327d0154486aa1225f39062de0f1e9b2d6b65dc9284fb7d265443"} Jul 13 22:17:57.847010 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:57.846973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" event={"ID":"379fefcf-5e69-427c-8f73-82a3c8df2f1d","Type":"ContainerStarted","Data":"6965ae5ffcf82bb11223ecbf85019e56e05aa74fc9b59b53e5c46bf051867526"} Jul 13 22:17:57.847398 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:57.847043 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:17:57.862361 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:17:57.862311 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" podStartSLOduration=1.710657174 podStartE2EDuration="4.862297162s" totalImagesPullingTime="3.151639988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:17:57.861666258 +0000 UTC m=+255.875663038" watchObservedRunningTime="2026-07-13 22:17:57.862297162 +0000 UTC m=+255.876293941" Jul 13 22:18:03.479448 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.479350 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84"] Jul 13 22:18:03.481638 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.481622 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" Jul 13 22:18:03.484062 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.484040 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qjnpc\"" Jul 13 22:18:03.484062 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.484051 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 22:18:03.485164 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.485135 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:18:03.490960 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.490936 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84"] Jul 13 22:18:03.600481 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.600435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhghr\" (UniqueName: \"kubernetes.io/projected/e6b53cf0-a100-46fd-9e77-36295ae65e3c-kube-api-access-vhghr\") pod \"openshift-lws-operator-fd8ccff4c-qqp84\" (UID: \"e6b53cf0-a100-46fd-9e77-36295ae65e3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" Jul 13 22:18:03.600661 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.600499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b53cf0-a100-46fd-9e77-36295ae65e3c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qqp84\" (UID: \"e6b53cf0-a100-46fd-9e77-36295ae65e3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" Jul 13 22:18:03.701336 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.701298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhghr\" (UniqueName: \"kubernetes.io/projected/e6b53cf0-a100-46fd-9e77-36295ae65e3c-kube-api-access-vhghr\") pod \"openshift-lws-operator-fd8ccff4c-qqp84\" (UID: \"e6b53cf0-a100-46fd-9e77-36295ae65e3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" Jul 13 22:18:03.701545 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.701353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b53cf0-a100-46fd-9e77-36295ae65e3c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qqp84\" (UID: \"e6b53cf0-a100-46fd-9e77-36295ae65e3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" Jul 13 22:18:03.701762 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.701746 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b53cf0-a100-46fd-9e77-36295ae65e3c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qqp84\" (UID: \"e6b53cf0-a100-46fd-9e77-36295ae65e3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" Jul 13 22:18:03.716074 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.716040 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhghr\" (UniqueName: \"kubernetes.io/projected/e6b53cf0-a100-46fd-9e77-36295ae65e3c-kube-api-access-vhghr\") pod \"openshift-lws-operator-fd8ccff4c-qqp84\" (UID: \"e6b53cf0-a100-46fd-9e77-36295ae65e3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" Jul 13 22:18:03.791564 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.791472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" Jul 13 22:18:03.857034 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.857000 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4qwpw" Jul 13 22:18:03.926193 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:03.926027 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84"] Jul 13 22:18:03.929051 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:18:03.929022 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6b53cf0_a100_46fd_9e77_36295ae65e3c.slice/crio-c6a8d40566abc40b9f4f1781b4f028dcc87ebf56d826d51ccb4983111dbae96a WatchSource:0}: Error finding container c6a8d40566abc40b9f4f1781b4f028dcc87ebf56d826d51ccb4983111dbae96a: Status 404 returned error can't find the container with id c6a8d40566abc40b9f4f1781b4f028dcc87ebf56d826d51ccb4983111dbae96a Jul 13 22:18:04.879574 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:04.879529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" event={"ID":"e6b53cf0-a100-46fd-9e77-36295ae65e3c","Type":"ContainerStarted","Data":"c6a8d40566abc40b9f4f1781b4f028dcc87ebf56d826d51ccb4983111dbae96a"} Jul 13 22:18:06.890645 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:06.890611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" event={"ID":"e6b53cf0-a100-46fd-9e77-36295ae65e3c","Type":"ContainerStarted","Data":"e91c38b1d8fa22ed05ff23d3af68ba6b81c69db4c09a447454dece66050815a9"} Jul 13 22:18:06.908602 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:06.908552 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qqp84" podStartSLOduration=1.644419622 podStartE2EDuration="3.908535512s" totalImagesPullingTime="2.26411589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:06.906648597 +0000 UTC m=+264.920645375" watchObservedRunningTime="2026-07-13 22:18:06.908535512 +0000 UTC m=+264.922532290" Jul 13 22:18:24.394249 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.394205 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2"] Jul 13 22:18:24.400828 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.400802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.404691 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.404663 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 22:18:24.404835 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.404688 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6fbvd\"" Jul 13 22:18:24.404835 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.404819 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 22:18:24.404952 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.404939 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 22:18:24.417127 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.417099 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2"] Jul 13 22:18:24.491626 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.491589 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8218aa51-5402-4359-a6d6-8da6a982e57e-manager-config\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.491626 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.491626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8218aa51-5402-4359-a6d6-8da6a982e57e-metrics-cert\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.491845 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.491670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh85w\" (UniqueName: \"kubernetes.io/projected/8218aa51-5402-4359-a6d6-8da6a982e57e-kube-api-access-hh85w\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.491845 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.491701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8218aa51-5402-4359-a6d6-8da6a982e57e-cert\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.592338 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.592298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8218aa51-5402-4359-a6d6-8da6a982e57e-manager-config\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.592338 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.592344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8218aa51-5402-4359-a6d6-8da6a982e57e-metrics-cert\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.592583 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.592388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh85w\" (UniqueName: \"kubernetes.io/projected/8218aa51-5402-4359-a6d6-8da6a982e57e-kube-api-access-hh85w\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.592583 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.592408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8218aa51-5402-4359-a6d6-8da6a982e57e-cert\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.593074 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.593050 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8218aa51-5402-4359-a6d6-8da6a982e57e-manager-config\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.594939 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.594907 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8218aa51-5402-4359-a6d6-8da6a982e57e-metrics-cert\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.595049 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.594986 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8218aa51-5402-4359-a6d6-8da6a982e57e-cert\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.612183 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.612152 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh85w\" (UniqueName: \"kubernetes.io/projected/8218aa51-5402-4359-a6d6-8da6a982e57e-kube-api-access-hh85w\") pod \"lws-controller-manager-84865b6cc-qnsv2\" (UID: \"8218aa51-5402-4359-a6d6-8da6a982e57e\") " pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.710826 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.710736 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:24.852014 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.851871 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2"] Jul 13 22:18:24.854844 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:18:24.854817 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8218aa51_5402_4359_a6d6_8da6a982e57e.slice/crio-d22f7174a8f565701e50a533ce0c2114b58165e94649f641f48af6482f01fa89 WatchSource:0}: Error finding container d22f7174a8f565701e50a533ce0c2114b58165e94649f641f48af6482f01fa89: Status 404 returned error can't find the container with id d22f7174a8f565701e50a533ce0c2114b58165e94649f641f48af6482f01fa89 Jul 13 22:18:24.968810 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:24.968726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" event={"ID":"8218aa51-5402-4359-a6d6-8da6a982e57e","Type":"ContainerStarted","Data":"d22f7174a8f565701e50a533ce0c2114b58165e94649f641f48af6482f01fa89"} Jul 13 22:18:26.979491 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:26.979384 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" event={"ID":"8218aa51-5402-4359-a6d6-8da6a982e57e","Type":"ContainerStarted","Data":"0bbad730349dd5a12954593a253e40c6ea530378a3c3e2f33d14bdef2434f38a"} Jul 13 22:18:26.979491 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:26.979479 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:27.021827 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.021779 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" podStartSLOduration=1.288409205 podStartE2EDuration="3.021762397s" totalImagesPullingTime="1.733353192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:27.02013939 +0000 UTC m=+285.034136173" watchObservedRunningTime="2026-07-13 22:18:27.021762397 +0000 UTC m=+285.035759233" Jul 13 22:18:27.654328 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.654291 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh"] Jul 13 22:18:27.656812 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.656795 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.659517 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.659488 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 22:18:27.659656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.659491 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 22:18:27.659656 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.659597 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 22:18:27.659829 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.659814 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 22:18:27.662773 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.662749 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2l2fh\"" Jul 13 22:18:27.670877 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.670854 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh"] Jul 13 22:18:27.721995 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.721953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/023c09b6-4915-4960-a829-e264e04976dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.722173 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.722017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/023c09b6-4915-4960-a829-e264e04976dc-manifests\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.722173 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.722085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/023c09b6-4915-4960-a829-e264e04976dc-tmp\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.722173 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.722124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxd6\" (UniqueName: \"kubernetes.io/projected/023c09b6-4915-4960-a829-e264e04976dc-kube-api-access-2nxd6\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.722173 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.722146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/023c09b6-4915-4960-a829-e264e04976dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.823367 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.823329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/023c09b6-4915-4960-a829-e264e04976dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.823590 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.823402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/023c09b6-4915-4960-a829-e264e04976dc-manifests\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.823590 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.823455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/023c09b6-4915-4960-a829-e264e04976dc-tmp\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.823590 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.823493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxd6\" (UniqueName: \"kubernetes.io/projected/023c09b6-4915-4960-a829-e264e04976dc-kube-api-access-2nxd6\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.823590 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.823521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/023c09b6-4915-4960-a829-e264e04976dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.823956 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.823919 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/023c09b6-4915-4960-a829-e264e04976dc-manifests\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.825984 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.825954 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/023c09b6-4915-4960-a829-e264e04976dc-tmp\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.826194 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.826175 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/023c09b6-4915-4960-a829-e264e04976dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.826330 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.826307 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/023c09b6-4915-4960-a829-e264e04976dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.836106 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.836078 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxd6\" (UniqueName: \"kubernetes.io/projected/023c09b6-4915-4960-a829-e264e04976dc-kube-api-access-2nxd6\") pod \"opendatahub-operator-controller-manager-d5bf5468b-n58fh\" (UID: \"023c09b6-4915-4960-a829-e264e04976dc\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:27.967572 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:27.967482 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:28.108476 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:28.108454 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh"] Jul 13 22:18:28.111152 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:18:28.111128 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023c09b6_4915_4960_a829_e264e04976dc.slice/crio-6e43bad5e0248fb72f2fcc531c6e6ae0079481b1da3b0e4ae8435d4862b911ef WatchSource:0}: Error finding container 6e43bad5e0248fb72f2fcc531c6e6ae0079481b1da3b0e4ae8435d4862b911ef: Status 404 returned error can't find the container with id 6e43bad5e0248fb72f2fcc531c6e6ae0079481b1da3b0e4ae8435d4862b911ef Jul 13 22:18:28.993200 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:28.993155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" event={"ID":"023c09b6-4915-4960-a829-e264e04976dc","Type":"ContainerStarted","Data":"6e43bad5e0248fb72f2fcc531c6e6ae0079481b1da3b0e4ae8435d4862b911ef"} Jul 13 22:18:32.011198 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:32.011159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" event={"ID":"023c09b6-4915-4960-a829-e264e04976dc","Type":"ContainerStarted","Data":"b43af1867aac5f94b670ee7871d1b941908f6453609c12e3cfb3a744a7448378"} Jul 13 22:18:33.017504 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:33.017467 2577 generic.go:356] "Generic (PLEG): container finished" podID="023c09b6-4915-4960-a829-e264e04976dc" containerID="b43af1867aac5f94b670ee7871d1b941908f6453609c12e3cfb3a744a7448378" exitCode=0 Jul 13 22:18:33.017878 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:33.017552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" event={"ID":"023c09b6-4915-4960-a829-e264e04976dc","Type":"ContainerDied","Data":"b43af1867aac5f94b670ee7871d1b941908f6453609c12e3cfb3a744a7448378"} Jul 13 22:18:34.023380 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:34.023340 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" event={"ID":"023c09b6-4915-4960-a829-e264e04976dc","Type":"ContainerStarted","Data":"ed98aa54767ca2171005fcc44cb183605177524077836d99731ee0b51bc51f70"} Jul 13 22:18:34.023822 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:34.023473 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:34.048572 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:34.048504 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" podStartSLOduration=2.535495153 podStartE2EDuration="7.048479389s" totalImagesPullingTime="3.344375055s" totalInitContainerRuntime="1.168609181s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:34.045033158 +0000 UTC m=+292.059029940" watchObservedRunningTime="2026-07-13 22:18:34.048479389 +0000 UTC m=+292.062476170" Jul 13 22:18:37.988196 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:37.988167 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84865b6cc-qnsv2" Jul 13 22:18:42.399440 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:42.399399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:18:42.404284 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:42.404260 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:18:42.406596 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:42.406575 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 22:18:45.029959 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:45.029923 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-n58fh" Jul 13 22:18:47.302521 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.302487 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67f58f88b6-h487g"] Jul 13 22:18:47.305711 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.305691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:47.308665 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.308645 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 22:18:47.309870 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.309847 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 22:18:47.309991 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.309888 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2hs74\"" Jul 13 22:18:47.309991 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.309903 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 22:18:47.309991 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.309901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 22:18:47.324602 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.324573 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67f58f88b6-h487g"] Jul 13 22:18:47.403505 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.403460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/798ab651-34ac-4237-b6ef-989576d88a4f-tls-certs\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:47.403681 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.403554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vhv\" (UniqueName: \"kubernetes.io/projected/798ab651-34ac-4237-b6ef-989576d88a4f-kube-api-access-69vhv\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:47.403681 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.403665 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798ab651-34ac-4237-b6ef-989576d88a4f-tmp\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:47.504308 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.504271 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vhv\" (UniqueName: \"kubernetes.io/projected/798ab651-34ac-4237-b6ef-989576d88a4f-kube-api-access-69vhv\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:47.504517 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.504348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798ab651-34ac-4237-b6ef-989576d88a4f-tmp\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:47.504517 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.504376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/798ab651-34ac-4237-b6ef-989576d88a4f-tls-certs\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:47.504590 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:18:47.504516 2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 13 22:18:47.504590 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:18:47.504577 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798ab651-34ac-4237-b6ef-989576d88a4f-tls-certs podName:798ab651-34ac-4237-b6ef-989576d88a4f nodeName:}" failed. No retries permitted until 2026-07-13 22:18:48.004558484 +0000 UTC m=+306.018555241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/798ab651-34ac-4237-b6ef-989576d88a4f-tls-certs") pod "kube-auth-proxy-67f58f88b6-h487g" (UID: "798ab651-34ac-4237-b6ef-989576d88a4f") : secret "kube-auth-proxy-tls" not found Jul 13 22:18:47.506824 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.506788 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/798ab651-34ac-4237-b6ef-989576d88a4f-tmp\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:47.524027 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:47.524000 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vhv\" (UniqueName: \"kubernetes.io/projected/798ab651-34ac-4237-b6ef-989576d88a4f-kube-api-access-69vhv\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:48.009732 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:48.009687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/798ab651-34ac-4237-b6ef-989576d88a4f-tls-certs\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:48.012306 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:48.012281 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/798ab651-34ac-4237-b6ef-989576d88a4f-tls-certs\") pod \"kube-auth-proxy-67f58f88b6-h487g\" (UID: \"798ab651-34ac-4237-b6ef-989576d88a4f\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:48.215065 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:48.215022 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" Jul 13 22:18:48.355250 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:48.355037 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67f58f88b6-h487g"] Jul 13 22:18:48.357361 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:18:48.357338 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798ab651_34ac_4237_b6ef_989576d88a4f.slice/crio-2fba64c33bb9d6a20e50348dc8d35cedc56377fe1da2d1c84925a2c6916b1529 WatchSource:0}: Error finding container 2fba64c33bb9d6a20e50348dc8d35cedc56377fe1da2d1c84925a2c6916b1529: Status 404 returned error can't find the container with id 2fba64c33bb9d6a20e50348dc8d35cedc56377fe1da2d1c84925a2c6916b1529 Jul 13 22:18:48.359291 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:48.359273 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 22:18:49.091443 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:49.091388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" event={"ID":"798ab651-34ac-4237-b6ef-989576d88a4f","Type":"ContainerStarted","Data":"2fba64c33bb9d6a20e50348dc8d35cedc56377fe1da2d1c84925a2c6916b1529"} Jul 13 22:18:52.108040 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:52.108001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" event={"ID":"798ab651-34ac-4237-b6ef-989576d88a4f","Type":"ContainerStarted","Data":"badd0a311ac68ac60d8a9f0110e1c415a61e97b5ba7eb12b71428e440151e37f"} Jul 13 22:18:52.124524 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:18:52.124475 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-h487g" podStartSLOduration=2.078493923 podStartE2EDuration="5.124457146s" totalImagesPullingTime="3.045963223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:52.123326786 +0000 UTC m=+310.137323566" watchObservedRunningTime="2026-07-13 22:18:52.124457146 +0000 UTC m=+310.138453956" Jul 13 22:20:51.093171 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.093135 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g"] Jul 13 22:20:51.095562 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.095547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:51.099122 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.099099 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 22:20:51.099608 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.099594 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 22:20:51.099719 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.099689 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-94xzr\"" Jul 13 22:20:51.119181 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.119154 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g"] Jul 13 22:20:51.188727 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.188693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2xc9\" (UniqueName: \"kubernetes.io/projected/35112336-ed61-4dba-8ba0-56f7f7de72d6-kube-api-access-m2xc9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkz6g\" (UID: \"35112336-ed61-4dba-8ba0-56f7f7de72d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:51.188901 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.188816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35112336-ed61-4dba-8ba0-56f7f7de72d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkz6g\" (UID: \"35112336-ed61-4dba-8ba0-56f7f7de72d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:51.289706 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.289664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xc9\" (UniqueName: \"kubernetes.io/projected/35112336-ed61-4dba-8ba0-56f7f7de72d6-kube-api-access-m2xc9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkz6g\" (UID: \"35112336-ed61-4dba-8ba0-56f7f7de72d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:51.289887 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.289776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35112336-ed61-4dba-8ba0-56f7f7de72d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkz6g\" (UID: \"35112336-ed61-4dba-8ba0-56f7f7de72d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:51.290153 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.290134 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35112336-ed61-4dba-8ba0-56f7f7de72d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkz6g\" (UID: \"35112336-ed61-4dba-8ba0-56f7f7de72d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:51.300354 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.300329 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xc9\" (UniqueName: \"kubernetes.io/projected/35112336-ed61-4dba-8ba0-56f7f7de72d6-kube-api-access-m2xc9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rkz6g\" (UID: \"35112336-ed61-4dba-8ba0-56f7f7de72d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:51.405283 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.405188 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:51.549560 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.549479 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g"] Jul 13 22:20:51.551948 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:20:51.551918 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35112336_ed61_4dba_8ba0_56f7f7de72d6.slice/crio-41967d8cc7722ae4aebe6c662ab64165d84d18a36f5463efa3eed0293495882b WatchSource:0}: Error finding container 41967d8cc7722ae4aebe6c662ab64165d84d18a36f5463efa3eed0293495882b: Status 404 returned error can't find the container with id 41967d8cc7722ae4aebe6c662ab64165d84d18a36f5463efa3eed0293495882b Jul 13 22:20:51.644626 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.644589 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" event={"ID":"35112336-ed61-4dba-8ba0-56f7f7de72d6","Type":"ContainerStarted","Data":"41967d8cc7722ae4aebe6c662ab64165d84d18a36f5463efa3eed0293495882b"} Jul 13 22:20:51.747968 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.747880 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g"] Jul 13 22:20:51.752583 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.752555 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g"] Jul 13 22:20:51.768127 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.768098 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx"] Jul 13 22:20:51.771074 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.771052 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:20:51.785251 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.785223 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx"] Jul 13 22:20:51.794676 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.794650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fskbg\" (UniqueName: \"kubernetes.io/projected/80a5baf4-8e5e-4719-a4b6-70e93421b48d-kube-api-access-fskbg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xs7qx\" (UID: \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:20:51.794838 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.794782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80a5baf4-8e5e-4719-a4b6-70e93421b48d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xs7qx\" (UID: \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:20:51.895244 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.895201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80a5baf4-8e5e-4719-a4b6-70e93421b48d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xs7qx\" (UID: \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:20:51.895467 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.895288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fskbg\" (UniqueName: \"kubernetes.io/projected/80a5baf4-8e5e-4719-a4b6-70e93421b48d-kube-api-access-fskbg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xs7qx\" (UID: \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:20:51.895621 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.895598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80a5baf4-8e5e-4719-a4b6-70e93421b48d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xs7qx\" (UID: \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:20:51.903654 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:51.903631 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fskbg\" (UniqueName: \"kubernetes.io/projected/80a5baf4-8e5e-4719-a4b6-70e93421b48d-kube-api-access-fskbg\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xs7qx\" (UID: \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:20:52.084019 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:52.083982 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:20:52.221996 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:52.221970 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx"] Jul 13 22:20:52.224346 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:20:52.224318 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a5baf4_8e5e_4719_a4b6_70e93421b48d.slice/crio-8bbb6001cdd53f2050df65da41a3c3c8c943ebebc6df94cae1a3eac433a4bdab WatchSource:0}: Error finding container 8bbb6001cdd53f2050df65da41a3c3c8c943ebebc6df94cae1a3eac433a4bdab: Status 404 returned error can't find the container with id 8bbb6001cdd53f2050df65da41a3c3c8c943ebebc6df94cae1a3eac433a4bdab Jul 13 22:20:52.650354 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:52.650319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" event={"ID":"80a5baf4-8e5e-4719-a4b6-70e93421b48d","Type":"ContainerStarted","Data":"8bbb6001cdd53f2050df65da41a3c3c8c943ebebc6df94cae1a3eac433a4bdab"} Jul 13 22:20:57.678131 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:57.678091 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" podUID="35112336-ed61-4dba-8ba0-56f7f7de72d6" containerName="manager" containerID="cri-o://a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6" gracePeriod=2 Jul 13 22:20:57.680780 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:57.680738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" event={"ID":"80a5baf4-8e5e-4719-a4b6-70e93421b48d","Type":"ContainerStarted","Data":"fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0"} Jul 13 22:20:57.680909 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:57.680886 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:20:57.700438 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:57.700372 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" podStartSLOduration=2.139301445 podStartE2EDuration="6.700354206s" totalImagesPullingTime="4.561052761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:20:57.700209094 +0000 UTC m=+435.714205873" watchObservedRunningTime="2026-07-13 22:20:57.700354206 +0000 UTC m=+435.714350986" Jul 13 22:20:57.925401 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:57.925370 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:57.927981 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:20:57.927951 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rkz6g\" is forbidden: User \"system:node:ip-10-0-132-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-225.ec2.internal' and this object" podUID="35112336-ed61-4dba-8ba0-56f7f7de72d6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:58.051164 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.051136 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2xc9\" (UniqueName: \"kubernetes.io/projected/35112336-ed61-4dba-8ba0-56f7f7de72d6-kube-api-access-m2xc9\") pod \"35112336-ed61-4dba-8ba0-56f7f7de72d6\" (UID: \"35112336-ed61-4dba-8ba0-56f7f7de72d6\") " Jul 13 22:20:58.051345 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.051205 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35112336-ed61-4dba-8ba0-56f7f7de72d6-extensions-socket-volume\") pod \"35112336-ed61-4dba-8ba0-56f7f7de72d6\" (UID: \"35112336-ed61-4dba-8ba0-56f7f7de72d6\") " Jul 13 22:20:58.051480 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.051409 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35112336-ed61-4dba-8ba0-56f7f7de72d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "35112336-ed61-4dba-8ba0-56f7f7de72d6" (UID: "35112336-ed61-4dba-8ba0-56f7f7de72d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:58.053534 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.053510 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35112336-ed61-4dba-8ba0-56f7f7de72d6-kube-api-access-m2xc9" (OuterVolumeSpecName: "kube-api-access-m2xc9") pod "35112336-ed61-4dba-8ba0-56f7f7de72d6" (UID: "35112336-ed61-4dba-8ba0-56f7f7de72d6"). InnerVolumeSpecName "kube-api-access-m2xc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:20:58.152158 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.152124 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35112336-ed61-4dba-8ba0-56f7f7de72d6-extensions-socket-volume\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:20:58.152158 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.152152 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2xc9\" (UniqueName: \"kubernetes.io/projected/35112336-ed61-4dba-8ba0-56f7f7de72d6-kube-api-access-m2xc9\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:20:58.566382 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.566352 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35112336-ed61-4dba-8ba0-56f7f7de72d6" path="/var/lib/kubelet/pods/35112336-ed61-4dba-8ba0-56f7f7de72d6/volumes" Jul 13 22:20:58.686270 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.686238 2577 generic.go:356] "Generic (PLEG): container finished" podID="35112336-ed61-4dba-8ba0-56f7f7de72d6" containerID="a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6" exitCode=2 Jul 13 22:20:58.686753 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.686284 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:58.686753 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.686333 2577 scope.go:117] "RemoveContainer" containerID="a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6" Jul 13 22:20:58.690679 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:20:58.690652 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rkz6g\" is forbidden: User \"system:node:ip-10-0-132-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-225.ec2.internal' and this object" podUID="35112336-ed61-4dba-8ba0-56f7f7de72d6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rkz6g" Jul 13 22:20:58.694764 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.694748 2577 scope.go:117] "RemoveContainer" containerID="a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6" Jul 13 22:20:58.695047 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:20:58.695030 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6\": container with ID starting with a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6 not found: ID does not exist" containerID="a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6" Jul 13 22:20:58.695093 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:20:58.695056 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6"} err="failed to get container status \"a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6\": rpc error: code = NotFound desc = could not find container \"a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6\": container with ID starting with a67eaf49984961efa6dc2d250296a7dfbb7eee8fe2a06ec014d87b2a8c8a9ce6 not found: ID does not exist" Jul 13 22:21:08.689556 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:08.689522 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:21:21.367769 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.367738 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx"] Jul 13 22:21:21.368239 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.368009 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" podUID="80a5baf4-8e5e-4719-a4b6-70e93421b48d" containerName="manager" containerID="cri-o://fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0" gracePeriod=10 Jul 13 22:21:21.621514 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.621455 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:21:21.673940 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.673907 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80a5baf4-8e5e-4719-a4b6-70e93421b48d-extensions-socket-volume\") pod \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\" (UID: \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\") " Jul 13 22:21:21.674115 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.673957 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fskbg\" (UniqueName: \"kubernetes.io/projected/80a5baf4-8e5e-4719-a4b6-70e93421b48d-kube-api-access-fskbg\") pod \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\" (UID: \"80a5baf4-8e5e-4719-a4b6-70e93421b48d\") " Jul 13 22:21:21.674468 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.674448 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80a5baf4-8e5e-4719-a4b6-70e93421b48d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "80a5baf4-8e5e-4719-a4b6-70e93421b48d" (UID: "80a5baf4-8e5e-4719-a4b6-70e93421b48d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:21:21.676114 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.676094 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80a5baf4-8e5e-4719-a4b6-70e93421b48d-kube-api-access-fskbg" (OuterVolumeSpecName: "kube-api-access-fskbg") pod "80a5baf4-8e5e-4719-a4b6-70e93421b48d" (UID: "80a5baf4-8e5e-4719-a4b6-70e93421b48d"). InnerVolumeSpecName "kube-api-access-fskbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:21:21.774773 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.774737 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80a5baf4-8e5e-4719-a4b6-70e93421b48d-extensions-socket-volume\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:21:21.774773 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.774771 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fskbg\" (UniqueName: \"kubernetes.io/projected/80a5baf4-8e5e-4719-a4b6-70e93421b48d-kube-api-access-fskbg\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:21:21.793173 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.793140 2577 generic.go:356] "Generic (PLEG): container finished" podID="80a5baf4-8e5e-4719-a4b6-70e93421b48d" containerID="fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0" exitCode=0 Jul 13 22:21:21.793352 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.793196 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" Jul 13 22:21:21.793352 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.793239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" event={"ID":"80a5baf4-8e5e-4719-a4b6-70e93421b48d","Type":"ContainerDied","Data":"fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0"} Jul 13 22:21:21.793352 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.793308 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx" event={"ID":"80a5baf4-8e5e-4719-a4b6-70e93421b48d","Type":"ContainerDied","Data":"8bbb6001cdd53f2050df65da41a3c3c8c943ebebc6df94cae1a3eac433a4bdab"} Jul 13 22:21:21.793352 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.793337 2577 scope.go:117] "RemoveContainer" containerID="fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0" Jul 13 22:21:21.803244 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.803227 2577 scope.go:117] "RemoveContainer" containerID="fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0" Jul 13 22:21:21.803515 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:21:21.803496 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0\": container with ID starting with fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0 not found: ID does not exist" containerID="fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0" Jul 13 22:21:21.803592 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.803526 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0"} err="failed to get container status \"fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0\": rpc error: code = NotFound desc = could not find container \"fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0\": container with ID starting with fcd81fe1db4bf18da16e6b25b1ae062fbf6313359a5ff09f02e2c12f8324bcc0 not found: ID does not exist" Jul 13 22:21:21.819759 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.819729 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx"] Jul 13 22:21:21.823622 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:21.823598 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xs7qx"] Jul 13 22:21:22.567442 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:22.567402 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80a5baf4-8e5e-4719-a4b6-70e93421b48d" path="/var/lib/kubelet/pods/80a5baf4-8e5e-4719-a4b6-70e93421b48d/volumes" Jul 13 22:21:25.103058 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.103026 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4"] Jul 13 22:21:25.103441 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.103356 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35112336-ed61-4dba-8ba0-56f7f7de72d6" containerName="manager" Jul 13 22:21:25.103441 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.103367 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="35112336-ed61-4dba-8ba0-56f7f7de72d6" containerName="manager" Jul 13 22:21:25.103441 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.103376 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80a5baf4-8e5e-4719-a4b6-70e93421b48d" containerName="manager" Jul 13 22:21:25.103441 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.103381 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="80a5baf4-8e5e-4719-a4b6-70e93421b48d" containerName="manager" Jul 13 22:21:25.103628 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.103482 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="80a5baf4-8e5e-4719-a4b6-70e93421b48d" containerName="manager" Jul 13 22:21:25.103628 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.103493 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="35112336-ed61-4dba-8ba0-56f7f7de72d6" containerName="manager" Jul 13 22:21:25.105857 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.105840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.109337 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.109316 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-f9b4d\"" Jul 13 22:21:25.112183 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.112165 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 22:21:25.122237 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.122208 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4"] Jul 13 22:21:25.200361 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.200328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.200361 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.200362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4257814-a6e1-4567-aae6-c4ec997f7320-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.200621 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.200392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.200621 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.200465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhkvw\" (UniqueName: \"kubernetes.io/projected/a4257814-a6e1-4567-aae6-c4ec997f7320-kube-api-access-zhkvw\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.200621 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.200505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.200621 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.200522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.200621 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.200544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.200621 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.200568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.200621 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.200626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.301820 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.301784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.301820 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.301821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhkvw\" (UniqueName: \"kubernetes.io/projected/a4257814-a6e1-4567-aae6-c4ec997f7320-kube-api-access-zhkvw\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302042 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.301844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302042 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.301858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302042 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.301988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302171 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.302047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302171 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.302132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302272 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.302210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302272 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.302236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4257814-a6e1-4567-aae6-c4ec997f7320-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302272 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.302249 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302466 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.302286 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302521 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.302470 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302573 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.302543 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.302824 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.302807 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4257814-a6e1-4567-aae6-c4ec997f7320-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.304402 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.304382 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.304755 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.304732 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.310906 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.310876 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4257814-a6e1-4567-aae6-c4ec997f7320-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.310906 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.310889 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhkvw\" (UniqueName: \"kubernetes.io/projected/a4257814-a6e1-4567-aae6-c4ec997f7320-kube-api-access-zhkvw\") pod \"maas-default-gateway-openshift-default-5896d4dd49-79lf4\" (UID: \"a4257814-a6e1-4567-aae6-c4ec997f7320\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.415164 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.415066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:25.580842 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.580818 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4"] Jul 13 22:21:25.583263 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:21:25.583238 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4257814_a6e1_4567_aae6_c4ec997f7320.slice/crio-1026e8366d7f3d0bd2e8440cc10bfd2d94399c864dc8aac1248d10caf06ed835 WatchSource:0}: Error finding container 1026e8366d7f3d0bd2e8440cc10bfd2d94399c864dc8aac1248d10caf06ed835: Status 404 returned error can't find the container with id 1026e8366d7f3d0bd2e8440cc10bfd2d94399c864dc8aac1248d10caf06ed835 Jul 13 22:21:25.816481 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:25.816408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" event={"ID":"a4257814-a6e1-4567-aae6-c4ec997f7320","Type":"ContainerStarted","Data":"1026e8366d7f3d0bd2e8440cc10bfd2d94399c864dc8aac1248d10caf06ed835"} Jul 13 22:21:28.068266 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:28.068227 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 22:21:28.068525 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:28.068315 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 22:21:28.068525 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:28.068347 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 22:21:28.833963 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:28.833925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" event={"ID":"a4257814-a6e1-4567-aae6-c4ec997f7320","Type":"ContainerStarted","Data":"d6837f6908f0970b59d1ac6c29cb035d530cf909507fbde29dddc72857e6c57d"} Jul 13 22:21:28.853679 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:28.853621 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" podStartSLOduration=1.370812148 podStartE2EDuration="3.853603847s" totalImagesPullingTime="2.482791699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:28.852519689 +0000 UTC m=+466.866516463" watchObservedRunningTime="2026-07-13 22:21:28.853603847 +0000 UTC m=+466.867600626" Jul 13 22:21:29.415695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:29.415652 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:29.420317 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:29.420290 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:29.840040 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:29.840009 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:29.841142 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:29.841122 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:21:38.481950 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.481910 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh54j"] Jul 13 22:21:38.485617 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.485594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:38.488352 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.488326 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 22:21:38.488539 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.488330 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 22:21:38.489333 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.489319 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hfx7c\"" Jul 13 22:21:38.489333 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.489326 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 22:21:38.493490 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.493473 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh54j"] Jul 13 22:21:38.528685 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.528651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmgzp\" (UniqueName: \"kubernetes.io/projected/27adea64-2980-43ff-a4a7-fe0947c455e2-kube-api-access-pmgzp\") pod \"limitador-limitador-64c94fd64f-bh54j\" (UID: \"27adea64-2980-43ff-a4a7-fe0947c455e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:38.528859 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.528727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27adea64-2980-43ff-a4a7-fe0947c455e2-config-file\") pod \"limitador-limitador-64c94fd64f-bh54j\" (UID: \"27adea64-2980-43ff-a4a7-fe0947c455e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:38.584579 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.584546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh54j"] Jul 13 22:21:38.630079 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.630043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27adea64-2980-43ff-a4a7-fe0947c455e2-config-file\") pod \"limitador-limitador-64c94fd64f-bh54j\" (UID: \"27adea64-2980-43ff-a4a7-fe0947c455e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:38.630241 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.630123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmgzp\" (UniqueName: \"kubernetes.io/projected/27adea64-2980-43ff-a4a7-fe0947c455e2-kube-api-access-pmgzp\") pod \"limitador-limitador-64c94fd64f-bh54j\" (UID: \"27adea64-2980-43ff-a4a7-fe0947c455e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:38.630748 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.630729 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27adea64-2980-43ff-a4a7-fe0947c455e2-config-file\") pod \"limitador-limitador-64c94fd64f-bh54j\" (UID: \"27adea64-2980-43ff-a4a7-fe0947c455e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:38.637825 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.637799 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmgzp\" (UniqueName: \"kubernetes.io/projected/27adea64-2980-43ff-a4a7-fe0947c455e2-kube-api-access-pmgzp\") pod \"limitador-limitador-64c94fd64f-bh54j\" (UID: \"27adea64-2980-43ff-a4a7-fe0947c455e2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:38.796544 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.796445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:38.929442 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:38.927818 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh54j"] Jul 13 22:21:38.931783 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:21:38.931746 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27adea64_2980_43ff_a4a7_fe0947c455e2.slice/crio-61332af5a5a2f59f3bd06570a0e83b521bd7e55e93ede60b6b2f846954b4eb04 WatchSource:0}: Error finding container 61332af5a5a2f59f3bd06570a0e83b521bd7e55e93ede60b6b2f846954b4eb04: Status 404 returned error can't find the container with id 61332af5a5a2f59f3bd06570a0e83b521bd7e55e93ede60b6b2f846954b4eb04 Jul 13 22:21:39.312333 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.312289 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jg2kx"] Jul 13 22:21:39.318711 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.318677 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jg2kx"] Jul 13 22:21:39.318868 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.318805 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jg2kx" Jul 13 22:21:39.321313 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.321290 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2rp6\"" Jul 13 22:21:39.438675 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.438641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5wrl\" (UniqueName: \"kubernetes.io/projected/81942258-19d4-490e-b3f0-2c9c27e6a9eb-kube-api-access-s5wrl\") pod \"authorino-58cd955675-jg2kx\" (UID: \"81942258-19d4-490e-b3f0-2c9c27e6a9eb\") " pod="kuadrant-system/authorino-58cd955675-jg2kx" Jul 13 22:21:39.540001 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.539960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5wrl\" (UniqueName: \"kubernetes.io/projected/81942258-19d4-490e-b3f0-2c9c27e6a9eb-kube-api-access-s5wrl\") pod \"authorino-58cd955675-jg2kx\" (UID: \"81942258-19d4-490e-b3f0-2c9c27e6a9eb\") " pod="kuadrant-system/authorino-58cd955675-jg2kx" Jul 13 22:21:39.548630 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.548605 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5wrl\" (UniqueName: \"kubernetes.io/projected/81942258-19d4-490e-b3f0-2c9c27e6a9eb-kube-api-access-s5wrl\") pod \"authorino-58cd955675-jg2kx\" (UID: \"81942258-19d4-490e-b3f0-2c9c27e6a9eb\") " pod="kuadrant-system/authorino-58cd955675-jg2kx" Jul 13 22:21:39.628835 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.628692 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jg2kx" Jul 13 22:21:39.842407 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.842057 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jg2kx"] Jul 13 22:21:39.846195 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:21:39.846041 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81942258_19d4_490e_b3f0_2c9c27e6a9eb.slice/crio-470e3e374850e3fc30b812cdab790fb7df5f03134a908608af4c8226c3cddba6 WatchSource:0}: Error finding container 470e3e374850e3fc30b812cdab790fb7df5f03134a908608af4c8226c3cddba6: Status 404 returned error can't find the container with id 470e3e374850e3fc30b812cdab790fb7df5f03134a908608af4c8226c3cddba6 Jul 13 22:21:39.896267 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.896145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" event={"ID":"27adea64-2980-43ff-a4a7-fe0947c455e2","Type":"ContainerStarted","Data":"61332af5a5a2f59f3bd06570a0e83b521bd7e55e93ede60b6b2f846954b4eb04"} Jul 13 22:21:39.897641 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:39.897615 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jg2kx" event={"ID":"81942258-19d4-490e-b3f0-2c9c27e6a9eb","Type":"ContainerStarted","Data":"470e3e374850e3fc30b812cdab790fb7df5f03134a908608af4c8226c3cddba6"} Jul 13 22:21:43.920839 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:43.920804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" event={"ID":"27adea64-2980-43ff-a4a7-fe0947c455e2","Type":"ContainerStarted","Data":"58266f684e36119ff7c9c3d4c166bdea2b256fd907ac456e86abbec72525cca0"} Jul 13 22:21:43.921262 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:43.921010 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:43.922325 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:43.922299 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jg2kx" event={"ID":"81942258-19d4-490e-b3f0-2c9c27e6a9eb","Type":"ContainerStarted","Data":"26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f"} Jul 13 22:21:43.937657 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:43.937615 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" podStartSLOduration=1.3591964029999999 podStartE2EDuration="5.937603099s" totalImagesPullingTime="4.578406696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:43.936501155 +0000 UTC m=+481.950497934" watchObservedRunningTime="2026-07-13 22:21:43.937603099 +0000 UTC m=+481.951599877" Jul 13 22:21:43.950946 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:43.950909 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jg2kx" podStartSLOduration=1.229517538 podStartE2EDuration="4.950897435s" totalImagesPullingTime="3.721379897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:43.949333179 +0000 UTC m=+481.963329958" watchObservedRunningTime="2026-07-13 22:21:43.950897435 +0000 UTC m=+481.964894214" Jul 13 22:21:44.567615 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:44.567580 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jg2kx"] Jul 13 22:21:45.931911 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:45.931870 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jg2kx" podUID="81942258-19d4-490e-b3f0-2c9c27e6a9eb" containerName="authorino" containerID="cri-o://26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f" gracePeriod=30 Jul 13 22:21:46.181742 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.181719 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jg2kx" Jul 13 22:21:46.302568 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.302539 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5wrl\" (UniqueName: \"kubernetes.io/projected/81942258-19d4-490e-b3f0-2c9c27e6a9eb-kube-api-access-s5wrl\") pod \"81942258-19d4-490e-b3f0-2c9c27e6a9eb\" (UID: \"81942258-19d4-490e-b3f0-2c9c27e6a9eb\") " Jul 13 22:21:46.304727 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.304696 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81942258-19d4-490e-b3f0-2c9c27e6a9eb-kube-api-access-s5wrl" (OuterVolumeSpecName: "kube-api-access-s5wrl") pod "81942258-19d4-490e-b3f0-2c9c27e6a9eb" (UID: "81942258-19d4-490e-b3f0-2c9c27e6a9eb"). InnerVolumeSpecName "kube-api-access-s5wrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:21:46.404003 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.403968 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5wrl\" (UniqueName: \"kubernetes.io/projected/81942258-19d4-490e-b3f0-2c9c27e6a9eb-kube-api-access-s5wrl\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:21:46.937389 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.937292 2577 generic.go:356] "Generic (PLEG): container finished" podID="81942258-19d4-490e-b3f0-2c9c27e6a9eb" containerID="26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f" exitCode=0 Jul 13 22:21:46.937389 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.937337 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jg2kx" Jul 13 22:21:46.937884 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.937387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jg2kx" event={"ID":"81942258-19d4-490e-b3f0-2c9c27e6a9eb","Type":"ContainerDied","Data":"26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f"} Jul 13 22:21:46.937884 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.937462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jg2kx" event={"ID":"81942258-19d4-490e-b3f0-2c9c27e6a9eb","Type":"ContainerDied","Data":"470e3e374850e3fc30b812cdab790fb7df5f03134a908608af4c8226c3cddba6"} Jul 13 22:21:46.937884 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.937487 2577 scope.go:117] "RemoveContainer" containerID="26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f" Jul 13 22:21:46.946024 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.946009 2577 scope.go:117] "RemoveContainer" containerID="26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f" Jul 13 22:21:46.946292 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:21:46.946270 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f\": container with ID starting with 26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f not found: ID does not exist" containerID="26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f" Jul 13 22:21:46.946377 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.946301 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f"} err="failed to get container status \"26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f\": rpc error: code = NotFound desc = could not find container \"26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f\": container with ID starting with 26b829e1b88e642ad901798e97cc21a92286050c3ecea7265f67c12020e4ac3f not found: ID does not exist" Jul 13 22:21:46.952747 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.952723 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jg2kx"] Jul 13 22:21:46.954330 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:46.954313 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jg2kx"] Jul 13 22:21:48.566868 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:48.566838 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81942258-19d4-490e-b3f0-2c9c27e6a9eb" path="/var/lib/kubelet/pods/81942258-19d4-490e-b3f0-2c9c27e6a9eb/volumes" Jul 13 22:21:54.928283 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:54.928251 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:55.566881 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:55.566846 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh54j"] Jul 13 22:21:55.567071 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:55.567048 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" podUID="27adea64-2980-43ff-a4a7-fe0947c455e2" containerName="limitador" containerID="cri-o://58266f684e36119ff7c9c3d4c166bdea2b256fd907ac456e86abbec72525cca0" gracePeriod=30 Jul 13 22:21:55.981129 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:55.981094 2577 generic.go:356] "Generic (PLEG): container finished" podID="27adea64-2980-43ff-a4a7-fe0947c455e2" containerID="58266f684e36119ff7c9c3d4c166bdea2b256fd907ac456e86abbec72525cca0" exitCode=0 Jul 13 22:21:55.981506 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:55.981165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" event={"ID":"27adea64-2980-43ff-a4a7-fe0947c455e2","Type":"ContainerDied","Data":"58266f684e36119ff7c9c3d4c166bdea2b256fd907ac456e86abbec72525cca0"} Jul 13 22:21:56.514166 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.514142 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:56.596464 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.596412 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27adea64-2980-43ff-a4a7-fe0947c455e2-config-file\") pod \"27adea64-2980-43ff-a4a7-fe0947c455e2\" (UID: \"27adea64-2980-43ff-a4a7-fe0947c455e2\") " Jul 13 22:21:56.596628 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.596557 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmgzp\" (UniqueName: \"kubernetes.io/projected/27adea64-2980-43ff-a4a7-fe0947c455e2-kube-api-access-pmgzp\") pod \"27adea64-2980-43ff-a4a7-fe0947c455e2\" (UID: \"27adea64-2980-43ff-a4a7-fe0947c455e2\") " Jul 13 22:21:56.596762 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.596738 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27adea64-2980-43ff-a4a7-fe0947c455e2-config-file" (OuterVolumeSpecName: "config-file") pod "27adea64-2980-43ff-a4a7-fe0947c455e2" (UID: "27adea64-2980-43ff-a4a7-fe0947c455e2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:21:56.598693 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.598673 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27adea64-2980-43ff-a4a7-fe0947c455e2-kube-api-access-pmgzp" (OuterVolumeSpecName: "kube-api-access-pmgzp") pod "27adea64-2980-43ff-a4a7-fe0947c455e2" (UID: "27adea64-2980-43ff-a4a7-fe0947c455e2"). InnerVolumeSpecName "kube-api-access-pmgzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:21:56.697582 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.697500 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmgzp\" (UniqueName: \"kubernetes.io/projected/27adea64-2980-43ff-a4a7-fe0947c455e2-kube-api-access-pmgzp\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:21:56.697582 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.697529 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/27adea64-2980-43ff-a4a7-fe0947c455e2-config-file\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:21:56.987159 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.987078 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" event={"ID":"27adea64-2980-43ff-a4a7-fe0947c455e2","Type":"ContainerDied","Data":"61332af5a5a2f59f3bd06570a0e83b521bd7e55e93ede60b6b2f846954b4eb04"} Jul 13 22:21:56.987159 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.987101 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh54j" Jul 13 22:21:56.987159 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:56.987131 2577 scope.go:117] "RemoveContainer" containerID="58266f684e36119ff7c9c3d4c166bdea2b256fd907ac456e86abbec72525cca0" Jul 13 22:21:57.008788 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:57.008766 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh54j"] Jul 13 22:21:57.012980 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:57.012960 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh54j"] Jul 13 22:21:58.566337 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:21:58.566300 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27adea64-2980-43ff-a4a7-fe0947c455e2" path="/var/lib/kubelet/pods/27adea64-2980-43ff-a4a7-fe0947c455e2/volumes" Jul 13 22:22:01.781115 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.781081 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6phzt"] Jul 13 22:22:01.781700 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.781680 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27adea64-2980-43ff-a4a7-fe0947c455e2" containerName="limitador" Jul 13 22:22:01.781757 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.781705 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27adea64-2980-43ff-a4a7-fe0947c455e2" containerName="limitador" Jul 13 22:22:01.781757 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.781737 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81942258-19d4-490e-b3f0-2c9c27e6a9eb" containerName="authorino" Jul 13 22:22:01.781757 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.781746 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="81942258-19d4-490e-b3f0-2c9c27e6a9eb" containerName="authorino" Jul 13 22:22:01.781860 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.781850 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27adea64-2980-43ff-a4a7-fe0947c455e2" containerName="limitador" Jul 13 22:22:01.781892 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.781863 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="81942258-19d4-490e-b3f0-2c9c27e6a9eb" containerName="authorino" Jul 13 22:22:01.786742 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.786721 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:01.789790 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.789766 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jtnhn\"" Jul 13 22:22:01.800105 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.790892 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 13 22:22:01.800105 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.791048 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 13 22:22:01.800105 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.791235 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 13 22:22:01.800105 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.796137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6phzt"] Jul 13 22:22:01.945096 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.945058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0baf3565-2038-4f78-a5af-daa30837fbf7-data\") pod \"postgres-69fb4594cf-6phzt\" (UID: \"0baf3565-2038-4f78-a5af-daa30837fbf7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:01.945096 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:01.945096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcrz8\" (UniqueName: \"kubernetes.io/projected/0baf3565-2038-4f78-a5af-daa30837fbf7-kube-api-access-fcrz8\") pod \"postgres-69fb4594cf-6phzt\" (UID: \"0baf3565-2038-4f78-a5af-daa30837fbf7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:02.046582 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:02.046500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0baf3565-2038-4f78-a5af-daa30837fbf7-data\") pod \"postgres-69fb4594cf-6phzt\" (UID: \"0baf3565-2038-4f78-a5af-daa30837fbf7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:02.046582 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:02.046538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcrz8\" (UniqueName: \"kubernetes.io/projected/0baf3565-2038-4f78-a5af-daa30837fbf7-kube-api-access-fcrz8\") pod \"postgres-69fb4594cf-6phzt\" (UID: \"0baf3565-2038-4f78-a5af-daa30837fbf7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:02.046907 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:02.046884 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0baf3565-2038-4f78-a5af-daa30837fbf7-data\") pod \"postgres-69fb4594cf-6phzt\" (UID: \"0baf3565-2038-4f78-a5af-daa30837fbf7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:02.054279 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:02.054261 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcrz8\" (UniqueName: \"kubernetes.io/projected/0baf3565-2038-4f78-a5af-daa30837fbf7-kube-api-access-fcrz8\") pod \"postgres-69fb4594cf-6phzt\" (UID: \"0baf3565-2038-4f78-a5af-daa30837fbf7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:02.101738 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:02.101700 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:02.230375 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:02.230352 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6phzt"] Jul 13 22:22:02.232763 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:22:02.232734 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0baf3565_2038_4f78_a5af_daa30837fbf7.slice/crio-367b2e16e2ae0e52b504732b81d05373b0e4d05d03c401fc8d96744d3f2584f6 WatchSource:0}: Error finding container 367b2e16e2ae0e52b504732b81d05373b0e4d05d03c401fc8d96744d3f2584f6: Status 404 returned error can't find the container with id 367b2e16e2ae0e52b504732b81d05373b0e4d05d03c401fc8d96744d3f2584f6 Jul 13 22:22:03.018224 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:03.018182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" event={"ID":"0baf3565-2038-4f78-a5af-daa30837fbf7","Type":"ContainerStarted","Data":"367b2e16e2ae0e52b504732b81d05373b0e4d05d03c401fc8d96744d3f2584f6"} Jul 13 22:22:07.041387 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:07.041346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" event={"ID":"0baf3565-2038-4f78-a5af-daa30837fbf7","Type":"ContainerStarted","Data":"4bbbaa8eb7fc7e4bdc9774f37e010187e9a9fad63151c73b1a8ba0581dd72e0a"} Jul 13 22:22:07.041860 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:07.041455 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:07.059259 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:07.059204 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" podStartSLOduration=1.449127631 podStartE2EDuration="6.059188188s" totalImagesPullingTime="4.610060557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:22:07.058262886 +0000 UTC m=+505.072259661" watchObservedRunningTime="2026-07-13 22:22:07.059188188 +0000 UTC m=+505.073184966" Jul 13 22:22:13.076881 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:13.076854 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6phzt" Jul 13 22:22:20.080509 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.080473 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fdcc797d4-d95f9"] Jul 13 22:22:20.086913 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.086887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:20.089642 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.089616 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 22:22:20.089642 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.089624 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-749kc\"" Jul 13 22:22:20.090631 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.090607 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 22:22:20.093316 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.093292 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdcc797d4-d95f9"] Jul 13 22:22:20.121096 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.121068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zszwc\" (UniqueName: \"kubernetes.io/projected/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-kube-api-access-zszwc\") pod \"maas-controller-6fdcc797d4-d95f9\" (UID: \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\") " pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:20.121268 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.121155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-webhook-cert\") pod \"maas-controller-6fdcc797d4-d95f9\" (UID: \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\") " pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:20.221808 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.221773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zszwc\" (UniqueName: \"kubernetes.io/projected/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-kube-api-access-zszwc\") pod \"maas-controller-6fdcc797d4-d95f9\" (UID: \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\") " pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:20.222023 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.221854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-webhook-cert\") pod \"maas-controller-6fdcc797d4-d95f9\" (UID: \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\") " pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:20.224472 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.224410 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-webhook-cert\") pod \"maas-controller-6fdcc797d4-d95f9\" (UID: \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\") " pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:20.232146 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.232122 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zszwc\" (UniqueName: \"kubernetes.io/projected/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-kube-api-access-zszwc\") pod \"maas-controller-6fdcc797d4-d95f9\" (UID: \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\") " pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:20.249683 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.249654 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc4c9f7b4-n77rq"] Jul 13 22:22:20.257336 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.257313 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:20.261082 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.261055 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc4c9f7b4-n77rq"] Jul 13 22:22:20.322475 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.322405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2969\" (UniqueName: \"kubernetes.io/projected/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-kube-api-access-b2969\") pod \"maas-controller-6bc4c9f7b4-n77rq\" (UID: \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\") " pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:20.322671 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.322519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-webhook-cert\") pod \"maas-controller-6bc4c9f7b4-n77rq\" (UID: \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\") " pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:20.398368 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.398288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:20.423760 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.423733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2969\" (UniqueName: \"kubernetes.io/projected/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-kube-api-access-b2969\") pod \"maas-controller-6bc4c9f7b4-n77rq\" (UID: \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\") " pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:20.423906 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.423791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-webhook-cert\") pod \"maas-controller-6bc4c9f7b4-n77rq\" (UID: \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\") " pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:20.426363 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.426338 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-webhook-cert\") pod \"maas-controller-6bc4c9f7b4-n77rq\" (UID: \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\") " pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:20.431950 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.431924 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2969\" (UniqueName: \"kubernetes.io/projected/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-kube-api-access-b2969\") pod \"maas-controller-6bc4c9f7b4-n77rq\" (UID: \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\") " pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:20.536583 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.536503 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdcc797d4-d95f9"] Jul 13 22:22:20.538813 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:22:20.538790 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dbb58af_c9ed_4add_9e8e_8a863f470cc3.slice/crio-fbe2e0cb6f12086c4c07c18a279b8a925fa036206b175a4e472e49bc2e9e603c WatchSource:0}: Error finding container fbe2e0cb6f12086c4c07c18a279b8a925fa036206b175a4e472e49bc2e9e603c: Status 404 returned error can't find the container with id fbe2e0cb6f12086c4c07c18a279b8a925fa036206b175a4e472e49bc2e9e603c Jul 13 22:22:20.569934 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.569890 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:20.702256 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:20.702234 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc4c9f7b4-n77rq"] Jul 13 22:22:20.704355 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:22:20.704328 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef65461_f303_4ee4_a9b4_2725a55c4f0f.slice/crio-8c17034caee231bad214b2deec254105cefb0e41531e49db3cb4cb4307ce04f2 WatchSource:0}: Error finding container 8c17034caee231bad214b2deec254105cefb0e41531e49db3cb4cb4307ce04f2: Status 404 returned error can't find the container with id 8c17034caee231bad214b2deec254105cefb0e41531e49db3cb4cb4307ce04f2 Jul 13 22:22:21.110064 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:21.110031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" event={"ID":"1ef65461-f303-4ee4-a9b4-2725a55c4f0f","Type":"ContainerStarted","Data":"8c17034caee231bad214b2deec254105cefb0e41531e49db3cb4cb4307ce04f2"} Jul 13 22:22:21.111767 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:21.111736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" event={"ID":"3dbb58af-c9ed-4add-9e8e-8a863f470cc3","Type":"ContainerStarted","Data":"fbe2e0cb6f12086c4c07c18a279b8a925fa036206b175a4e472e49bc2e9e603c"} Jul 13 22:22:23.124561 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:23.124529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" event={"ID":"1ef65461-f303-4ee4-a9b4-2725a55c4f0f","Type":"ContainerStarted","Data":"c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2"} Jul 13 22:22:23.125053 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:23.124699 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:23.126449 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:23.126395 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" event={"ID":"3dbb58af-c9ed-4add-9e8e-8a863f470cc3","Type":"ContainerStarted","Data":"766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0"} Jul 13 22:22:23.126577 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:23.126494 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:23.144016 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:23.143955 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" podStartSLOduration=1.29067095 podStartE2EDuration="3.14393631s" totalImagesPullingTime="1.85326536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:22:23.142206564 +0000 UTC m=+521.156203357" watchObservedRunningTime="2026-07-13 22:22:23.14393631 +0000 UTC m=+521.157933091" Jul 13 22:22:23.158737 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:23.158674 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" podStartSLOduration=1.149542518 podStartE2EDuration="3.158652654s" totalImagesPullingTime="2.009110136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:22:23.158599559 +0000 UTC m=+521.172596339" watchObservedRunningTime="2026-07-13 22:22:23.158652654 +0000 UTC m=+521.172649434" Jul 13 22:22:34.137591 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.137512 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:34.137591 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.137584 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:22:34.198474 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.198441 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fdcc797d4-d95f9"] Jul 13 22:22:34.198688 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.198665 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" podUID="3dbb58af-c9ed-4add-9e8e-8a863f470cc3" containerName="manager" containerID="cri-o://766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0" gracePeriod=30 Jul 13 22:22:34.438739 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.438716 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:34.563550 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.563517 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zszwc\" (UniqueName: \"kubernetes.io/projected/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-kube-api-access-zszwc\") pod \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\" (UID: \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\") " Jul 13 22:22:34.563724 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.563623 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-webhook-cert\") pod \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\" (UID: \"3dbb58af-c9ed-4add-9e8e-8a863f470cc3\") " Jul 13 22:22:34.565911 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.565873 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3dbb58af-c9ed-4add-9e8e-8a863f470cc3" (UID: "3dbb58af-c9ed-4add-9e8e-8a863f470cc3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:22:34.565911 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.565877 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-kube-api-access-zszwc" (OuterVolumeSpecName: "kube-api-access-zszwc") pod "3dbb58af-c9ed-4add-9e8e-8a863f470cc3" (UID: "3dbb58af-c9ed-4add-9e8e-8a863f470cc3"). InnerVolumeSpecName "kube-api-access-zszwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:22:34.664758 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.664715 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-webhook-cert\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:22:34.664758 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:34.664748 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zszwc\" (UniqueName: \"kubernetes.io/projected/3dbb58af-c9ed-4add-9e8e-8a863f470cc3-kube-api-access-zszwc\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:22:35.187959 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:35.187926 2577 generic.go:356] "Generic (PLEG): container finished" podID="3dbb58af-c9ed-4add-9e8e-8a863f470cc3" containerID="766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0" exitCode=0 Jul 13 22:22:35.188356 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:35.187973 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" Jul 13 22:22:35.188356 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:35.187986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" event={"ID":"3dbb58af-c9ed-4add-9e8e-8a863f470cc3","Type":"ContainerDied","Data":"766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0"} Jul 13 22:22:35.188356 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:35.188027 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdcc797d4-d95f9" event={"ID":"3dbb58af-c9ed-4add-9e8e-8a863f470cc3","Type":"ContainerDied","Data":"fbe2e0cb6f12086c4c07c18a279b8a925fa036206b175a4e472e49bc2e9e603c"} Jul 13 22:22:35.188356 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:35.188049 2577 scope.go:117] "RemoveContainer" containerID="766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0" Jul 13 22:22:35.199065 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:35.199041 2577 scope.go:117] "RemoveContainer" containerID="766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0" Jul 13 22:22:35.199411 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:22:35.199387 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0\": container with ID starting with 766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0 not found: ID does not exist" containerID="766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0" Jul 13 22:22:35.199487 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:35.199447 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0"} err="failed to get container status \"766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0\": rpc error: code = NotFound desc = could not find container \"766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0\": container with ID starting with 766ebeaa8757366e7d2b1945495880efe0436f4d52fe465c0cc139cbe595d2b0 not found: ID does not exist" Jul 13 22:22:35.204237 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:35.204211 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fdcc797d4-d95f9"] Jul 13 22:22:35.209813 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:35.209791 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fdcc797d4-d95f9"] Jul 13 22:22:36.568179 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:36.568145 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dbb58af-c9ed-4add-9e8e-8a863f470cc3" path="/var/lib/kubelet/pods/3dbb58af-c9ed-4add-9e8e-8a863f470cc3/volumes" Jul 13 22:22:55.406289 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.406254 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wnlxb"] Jul 13 22:22:55.406928 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.406868 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dbb58af-c9ed-4add-9e8e-8a863f470cc3" containerName="manager" Jul 13 22:22:55.406928 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.406888 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dbb58af-c9ed-4add-9e8e-8a863f470cc3" containerName="manager" Jul 13 22:22:55.407056 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.406992 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dbb58af-c9ed-4add-9e8e-8a863f470cc3" containerName="manager" Jul 13 22:22:55.431857 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.431828 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wnlxb"] Jul 13 22:22:55.432003 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.431920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:22:55.434598 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.434576 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lv25x\"" Jul 13 22:22:55.434750 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.434624 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 13 22:22:55.447487 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.447456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66c4cc5a-7380-4ff1-91b0-d67a1272c1c1-plugins-config-volume\") pod \"payload-processing-58f86c7798-wnlxb\" (UID: \"66c4cc5a-7380-4ff1-91b0-d67a1272c1c1\") " pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:22:55.447622 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.447534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr286\" (UniqueName: \"kubernetes.io/projected/66c4cc5a-7380-4ff1-91b0-d67a1272c1c1-kube-api-access-fr286\") pod \"payload-processing-58f86c7798-wnlxb\" (UID: \"66c4cc5a-7380-4ff1-91b0-d67a1272c1c1\") " pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:22:55.548975 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.548930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66c4cc5a-7380-4ff1-91b0-d67a1272c1c1-plugins-config-volume\") pod \"payload-processing-58f86c7798-wnlxb\" (UID: \"66c4cc5a-7380-4ff1-91b0-d67a1272c1c1\") " pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:22:55.548975 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.549014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr286\" (UniqueName: \"kubernetes.io/projected/66c4cc5a-7380-4ff1-91b0-d67a1272c1c1-kube-api-access-fr286\") pod \"payload-processing-58f86c7798-wnlxb\" (UID: \"66c4cc5a-7380-4ff1-91b0-d67a1272c1c1\") " pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:22:55.549989 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.549965 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66c4cc5a-7380-4ff1-91b0-d67a1272c1c1-plugins-config-volume\") pod \"payload-processing-58f86c7798-wnlxb\" (UID: \"66c4cc5a-7380-4ff1-91b0-d67a1272c1c1\") " pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:22:55.560286 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.560256 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr286\" (UniqueName: \"kubernetes.io/projected/66c4cc5a-7380-4ff1-91b0-d67a1272c1c1-kube-api-access-fr286\") pod \"payload-processing-58f86c7798-wnlxb\" (UID: \"66c4cc5a-7380-4ff1-91b0-d67a1272c1c1\") " pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:22:55.742613 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.742521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:22:55.877230 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:55.877206 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wnlxb"] Jul 13 22:22:55.879416 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:22:55.879385 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c4cc5a_7380_4ff1_91b0_d67a1272c1c1.slice/crio-1899e7ba38321c223e8f0ffb4f8a7f5cb1b01197198cdf23e558b17b4fdfed08 WatchSource:0}: Error finding container 1899e7ba38321c223e8f0ffb4f8a7f5cb1b01197198cdf23e558b17b4fdfed08: Status 404 returned error can't find the container with id 1899e7ba38321c223e8f0ffb4f8a7f5cb1b01197198cdf23e558b17b4fdfed08 Jul 13 22:22:56.293364 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:56.293320 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" event={"ID":"66c4cc5a-7380-4ff1-91b0-d67a1272c1c1","Type":"ContainerStarted","Data":"1899e7ba38321c223e8f0ffb4f8a7f5cb1b01197198cdf23e558b17b4fdfed08"} Jul 13 22:22:58.311986 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:58.311947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" event={"ID":"66c4cc5a-7380-4ff1-91b0-d67a1272c1c1","Type":"ContainerStarted","Data":"e237ae3366a806b2824e1e094a297a8e2ddde6e5d58ccc52c5039f626e277e19"} Jul 13 22:22:58.312494 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:58.312048 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:22:58.328135 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:22:58.328078 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" podStartSLOduration=1.767554775 podStartE2EDuration="3.328060532s" totalImagesPullingTime="1.560505757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:22:58.326775826 +0000 UTC m=+556.340772645" watchObservedRunningTime="2026-07-13 22:22:58.328060532 +0000 UTC m=+556.342057311" Jul 13 22:23:03.339284 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:03.339250 2577 generic.go:356] "Generic (PLEG): container finished" podID="a4257814-a6e1-4567-aae6-c4ec997f7320" containerID="d6837f6908f0970b59d1ac6c29cb035d530cf909507fbde29dddc72857e6c57d" exitCode=0 Jul 13 22:23:03.339716 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:03.339294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" event={"ID":"a4257814-a6e1-4567-aae6-c4ec997f7320","Type":"ContainerDied","Data":"d6837f6908f0970b59d1ac6c29cb035d530cf909507fbde29dddc72857e6c57d"} Jul 13 22:23:03.339768 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:03.339721 2577 scope.go:117] "RemoveContainer" containerID="d6837f6908f0970b59d1ac6c29cb035d530cf909507fbde29dddc72857e6c57d" Jul 13 22:23:03.340710 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:03.340677 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 22:23:03.340770 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:03.340759 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 22:23:03.340805 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:03.340790 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 22:23:04.345992 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:04.345954 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" event={"ID":"a4257814-a6e1-4567-aae6-c4ec997f7320","Type":"ContainerStarted","Data":"59e05e884f02dde62c621b2397d971d7a55fbbd37f57357d4912313280ff5318"} Jul 13 22:23:04.416264 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:04.416223 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:23:04.416529 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:04.416500 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-79lf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 13 22:23:04.416620 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:04.416561 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" podUID="a4257814-a6e1-4567-aae6-c4ec997f7320" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 13 22:23:05.415811 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:05.415774 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-79lf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 13 22:23:05.416190 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:05.415824 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" podUID="a4257814-a6e1-4567-aae6-c4ec997f7320" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 13 22:23:06.415579 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:06.415539 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-79lf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 13 22:23:06.415767 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:06.415600 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" podUID="a4257814-a6e1-4567-aae6-c4ec997f7320" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 13 22:23:07.415752 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:07.415713 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-79lf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 13 22:23:07.416136 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:07.415768 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" podUID="a4257814-a6e1-4567-aae6-c4ec997f7320" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 13 22:23:08.419408 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:08.419370 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:23:08.419814 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:08.419764 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:23:08.420528 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:08.420510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-79lf4" Jul 13 22:23:09.318932 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:09.318898 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-wnlxb" Jul 13 22:23:13.889004 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:13.888968 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p"] Jul 13 22:23:13.892199 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:13.892172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:13.895230 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:13.895199 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 22:23:13.895450 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:13.895260 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 22:23:13.896547 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:13.896524 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2zd2s\"" Jul 13 22:23:13.896676 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:13.896521 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 13 22:23:13.910251 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:13.910230 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p"] Jul 13 22:23:14.031893 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.031841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb9nc\" (UniqueName: \"kubernetes.io/projected/683a47e7-e1ca-460f-bb9b-17cb491f34b0-kube-api-access-pb9nc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.032123 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.031995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/683a47e7-e1ca-460f-bb9b-17cb491f34b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.032123 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.032036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.032123 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.032085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.032123 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.032106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.032279 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.032169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.133613 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.133576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/683a47e7-e1ca-460f-bb9b-17cb491f34b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.133613 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.133615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.133879 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.133752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.133879 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.133786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.133986 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.133909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.133986 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.133943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb9nc\" (UniqueName: \"kubernetes.io/projected/683a47e7-e1ca-460f-bb9b-17cb491f34b0-kube-api-access-pb9nc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.134091 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.134030 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.134091 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.134079 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.134193 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.134144 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.136257 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.136233 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/683a47e7-e1ca-460f-bb9b-17cb491f34b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.136350 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.136272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/683a47e7-e1ca-460f-bb9b-17cb491f34b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.141647 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.141597 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb9nc\" (UniqueName: \"kubernetes.io/projected/683a47e7-e1ca-460f-bb9b-17cb491f34b0-kube-api-access-pb9nc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p\" (UID: \"683a47e7-e1ca-460f-bb9b-17cb491f34b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.203371 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.203339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:14.355304 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.355281 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p"] Jul 13 22:23:14.357375 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:23:14.357340 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683a47e7_e1ca_460f_bb9b_17cb491f34b0.slice/crio-1a56394821726cdbd2e8c838c383ca3cdf7e705889dc4b22829bedbd210906d0 WatchSource:0}: Error finding container 1a56394821726cdbd2e8c838c383ca3cdf7e705889dc4b22829bedbd210906d0: Status 404 returned error can't find the container with id 1a56394821726cdbd2e8c838c383ca3cdf7e705889dc4b22829bedbd210906d0 Jul 13 22:23:14.401810 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:14.401711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" event={"ID":"683a47e7-e1ca-460f-bb9b-17cb491f34b0","Type":"ContainerStarted","Data":"1a56394821726cdbd2e8c838c383ca3cdf7e705889dc4b22829bedbd210906d0"} Jul 13 22:23:16.416597 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:16.416551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" event={"ID":"683a47e7-e1ca-460f-bb9b-17cb491f34b0","Type":"ContainerStarted","Data":"6416bebc3911fc4526e2a0bb4e046fcaaf8c7084a260ddf5ee410c7cc2eacc06"} Jul 13 22:23:16.432701 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:16.432560 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" podStartSLOduration=2.360265194 podStartE2EDuration="3.432541667s" totalImagesPullingTime="1.072276473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:23:16.431488446 +0000 UTC m=+574.445485226" watchObservedRunningTime="2026-07-13 22:23:16.432541667 +0000 UTC m=+574.446538446" Jul 13 22:23:22.975417 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:22.975381 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g"] Jul 13 22:23:22.977963 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:22.977947 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:22.980296 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:22.980266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 13 22:23:22.988001 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:22.987970 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g"] Jul 13 22:23:23.123993 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.123956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe27dce-7434-4de5-b1a4-42638a27c09f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.124140 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.124008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.124140 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.124093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.124140 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.124118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.124140 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.124138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.124294 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.124220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5jb7\" (UniqueName: \"kubernetes.io/projected/8fe27dce-7434-4de5-b1a4-42638a27c09f-kube-api-access-b5jb7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.225003 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.224972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.225003 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.225006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.225202 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.225026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.225202 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.225088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5jb7\" (UniqueName: \"kubernetes.io/projected/8fe27dce-7434-4de5-b1a4-42638a27c09f-kube-api-access-b5jb7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.225202 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.225129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe27dce-7434-4de5-b1a4-42638a27c09f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.225202 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.225168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.225498 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.225440 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.225498 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.225475 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.225610 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.225518 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.227405 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.227386 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fe27dce-7434-4de5-b1a4-42638a27c09f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.227682 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.227665 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe27dce-7434-4de5-b1a4-42638a27c09f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.232955 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.232923 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5jb7\" (UniqueName: \"kubernetes.io/projected/8fe27dce-7434-4de5-b1a4-42638a27c09f-kube-api-access-b5jb7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6l59g\" (UID: \"8fe27dce-7434-4de5-b1a4-42638a27c09f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.288580 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.288539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:23.425581 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.425553 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g"] Jul 13 22:23:23.427348 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:23:23.427323 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe27dce_7434_4de5_b1a4_42638a27c09f.slice/crio-4e7bde6664289c70120eae6521b5c0f14bd37ff8bb4a335e04198216d01c1341 WatchSource:0}: Error finding container 4e7bde6664289c70120eae6521b5c0f14bd37ff8bb4a335e04198216d01c1341: Status 404 returned error can't find the container with id 4e7bde6664289c70120eae6521b5c0f14bd37ff8bb4a335e04198216d01c1341 Jul 13 22:23:23.450494 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:23.450461 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" event={"ID":"8fe27dce-7434-4de5-b1a4-42638a27c09f","Type":"ContainerStarted","Data":"4e7bde6664289c70120eae6521b5c0f14bd37ff8bb4a335e04198216d01c1341"} Jul 13 22:23:24.203776 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:24.203746 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:24.204272 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:24.203845 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:24.216486 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:24.216461 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:24.457216 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:24.457122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" event={"ID":"8fe27dce-7434-4de5-b1a4-42638a27c09f","Type":"ContainerStarted","Data":"ab7eda814b1ae5ed3e097bbb7e5281e8da9880c0181138f4fd4e5266a237dabd"} Jul 13 22:23:24.468527 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:24.468500 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p" Jul 13 22:23:24.475041 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:24.474996 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" podStartSLOduration=2.300318386 podStartE2EDuration="2.474979685s" totalImagesPullingTime="174.661299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:23:24.472699081 +0000 UTC m=+582.486695857" watchObservedRunningTime="2026-07-13 22:23:24.474979685 +0000 UTC m=+582.488976505" Jul 13 22:23:33.289178 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:33.289139 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:33.289765 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:33.289199 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:33.301454 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:33.301403 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:33.512688 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:33.512657 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6l59g" Jul 13 22:23:42.436889 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:42.436853 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:23:42.438913 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:23:42.438891 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:24:39.172653 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.172603 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fc99b8fc-cm7s8"] Jul 13 22:24:39.176036 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.176015 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" Jul 13 22:24:39.178815 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.178794 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 22:24:39.180019 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.180001 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 13 22:24:39.180122 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.180109 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2rp6\"" Jul 13 22:24:39.180310 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.180295 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 22:24:39.186988 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.186969 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fc99b8fc-cm7s8"] Jul 13 22:24:39.235253 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.235213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knxtw\" (UniqueName: \"kubernetes.io/projected/f568900a-7562-4efe-9b59-857e784bf3de-kube-api-access-knxtw\") pod \"authorino-6fc99b8fc-cm7s8\" (UID: \"f568900a-7562-4efe-9b59-857e784bf3de\") " pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" Jul 13 22:24:39.235448 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.235278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f568900a-7562-4efe-9b59-857e784bf3de-tls-cert\") pod \"authorino-6fc99b8fc-cm7s8\" (UID: \"f568900a-7562-4efe-9b59-857e784bf3de\") " pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" Jul 13 22:24:39.336501 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.336458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knxtw\" (UniqueName: \"kubernetes.io/projected/f568900a-7562-4efe-9b59-857e784bf3de-kube-api-access-knxtw\") pod \"authorino-6fc99b8fc-cm7s8\" (UID: \"f568900a-7562-4efe-9b59-857e784bf3de\") " pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" Jul 13 22:24:39.336689 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.336539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f568900a-7562-4efe-9b59-857e784bf3de-tls-cert\") pod \"authorino-6fc99b8fc-cm7s8\" (UID: \"f568900a-7562-4efe-9b59-857e784bf3de\") " pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" Jul 13 22:24:39.339121 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.339090 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f568900a-7562-4efe-9b59-857e784bf3de-tls-cert\") pod \"authorino-6fc99b8fc-cm7s8\" (UID: \"f568900a-7562-4efe-9b59-857e784bf3de\") " pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" Jul 13 22:24:39.345415 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.345393 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knxtw\" (UniqueName: \"kubernetes.io/projected/f568900a-7562-4efe-9b59-857e784bf3de-kube-api-access-knxtw\") pod \"authorino-6fc99b8fc-cm7s8\" (UID: \"f568900a-7562-4efe-9b59-857e784bf3de\") " pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" Jul 13 22:24:39.485775 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.485686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" Jul 13 22:24:39.637802 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.637769 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fc99b8fc-cm7s8"] Jul 13 22:24:39.639346 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:24:39.639321 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf568900a_7562_4efe_9b59_857e784bf3de.slice/crio-ba5cc4b5a0157c7c8a77fc66a1e8bd2ba3b66e7c8f71f65e4e82268cf13fc85e WatchSource:0}: Error finding container ba5cc4b5a0157c7c8a77fc66a1e8bd2ba3b66e7c8f71f65e4e82268cf13fc85e: Status 404 returned error can't find the container with id ba5cc4b5a0157c7c8a77fc66a1e8bd2ba3b66e7c8f71f65e4e82268cf13fc85e Jul 13 22:24:39.640695 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.640676 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 22:24:39.828662 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:39.828628 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" event={"ID":"f568900a-7562-4efe-9b59-857e784bf3de","Type":"ContainerStarted","Data":"ba5cc4b5a0157c7c8a77fc66a1e8bd2ba3b66e7c8f71f65e4e82268cf13fc85e"} Jul 13 22:24:40.836111 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:40.836073 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" event={"ID":"f568900a-7562-4efe-9b59-857e784bf3de","Type":"ContainerStarted","Data":"175d67d274b27ddf771de89ac6dc4bbfbfe57e56ad42e4cc365a3cc0dd8d8c07"} Jul 13 22:24:40.856792 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:24:40.856724 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6fc99b8fc-cm7s8" podStartSLOduration=1.4410281870000001 podStartE2EDuration="1.856700489s" totalImagesPullingTime="415.672302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:24:40.856014029 +0000 UTC m=+658.870010823" watchObservedRunningTime="2026-07-13 22:24:40.856700489 +0000 UTC m=+658.870697268" Jul 13 22:25:51.831781 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:51.831745 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc4c9f7b4-n77rq"] Jul 13 22:25:51.832399 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:51.831943 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" podUID="1ef65461-f303-4ee4-a9b4-2725a55c4f0f" containerName="manager" containerID="cri-o://c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2" gracePeriod=30 Jul 13 22:25:52.083827 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.083768 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:25:52.145357 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.145322 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-webhook-cert\") pod \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\" (UID: \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\") " Jul 13 22:25:52.145531 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.145471 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2969\" (UniqueName: \"kubernetes.io/projected/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-kube-api-access-b2969\") pod \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\" (UID: \"1ef65461-f303-4ee4-a9b4-2725a55c4f0f\") " Jul 13 22:25:52.147537 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.147508 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1ef65461-f303-4ee4-a9b4-2725a55c4f0f" (UID: "1ef65461-f303-4ee4-a9b4-2725a55c4f0f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:25:52.147669 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.147624 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-kube-api-access-b2969" (OuterVolumeSpecName: "kube-api-access-b2969") pod "1ef65461-f303-4ee4-a9b4-2725a55c4f0f" (UID: "1ef65461-f303-4ee4-a9b4-2725a55c4f0f"). InnerVolumeSpecName "kube-api-access-b2969". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:25:52.206300 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.206263 2577 generic.go:356] "Generic (PLEG): container finished" podID="1ef65461-f303-4ee4-a9b4-2725a55c4f0f" containerID="c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2" exitCode=0 Jul 13 22:25:52.206484 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.206306 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" Jul 13 22:25:52.206484 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.206325 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" event={"ID":"1ef65461-f303-4ee4-a9b4-2725a55c4f0f","Type":"ContainerDied","Data":"c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2"} Jul 13 22:25:52.206484 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.206366 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc4c9f7b4-n77rq" event={"ID":"1ef65461-f303-4ee4-a9b4-2725a55c4f0f","Type":"ContainerDied","Data":"8c17034caee231bad214b2deec254105cefb0e41531e49db3cb4cb4307ce04f2"} Jul 13 22:25:52.206484 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.206387 2577 scope.go:117] "RemoveContainer" containerID="c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2" Jul 13 22:25:52.216223 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.216205 2577 scope.go:117] "RemoveContainer" containerID="c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2" Jul 13 22:25:52.216542 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:25:52.216523 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2\": container with ID starting with c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2 not found: ID does not exist" containerID="c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2" Jul 13 22:25:52.216616 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.216551 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2"} err="failed to get container status \"c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2\": rpc error: code = NotFound desc = could not find container \"c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2\": container with ID starting with c87290cc1cac2693bc104b01a3b31e4283dc500d7e0c4ad39e6ee90f8bab1ab2 not found: ID does not exist" Jul 13 22:25:52.227955 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.227934 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc4c9f7b4-n77rq"] Jul 13 22:25:52.231295 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.231274 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bc4c9f7b4-n77rq"] Jul 13 22:25:52.246839 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.246811 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2969\" (UniqueName: \"kubernetes.io/projected/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-kube-api-access-b2969\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:25:52.246839 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.246838 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ef65461-f303-4ee4-a9b4-2725a55c4f0f-webhook-cert\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:25:52.574153 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:52.574117 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ef65461-f303-4ee4-a9b4-2725a55c4f0f" path="/var/lib/kubelet/pods/1ef65461-f303-4ee4-a9b4-2725a55c4f0f/volumes" Jul 13 22:25:53.023632 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.023536 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc4c9f7b4-pp7bk"] Jul 13 22:25:53.023993 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.023978 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ef65461-f303-4ee4-a9b4-2725a55c4f0f" containerName="manager" Jul 13 22:25:53.023993 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.023993 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ef65461-f303-4ee4-a9b4-2725a55c4f0f" containerName="manager" Jul 13 22:25:53.024087 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.024076 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ef65461-f303-4ee4-a9b4-2725a55c4f0f" containerName="manager" Jul 13 22:25:53.028479 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.028464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:25:53.032348 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.032322 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 22:25:53.032516 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.032348 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-749kc\"" Jul 13 22:25:53.032516 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.032324 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 22:25:53.036337 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.036315 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc4c9f7b4-pp7bk"] Jul 13 22:25:53.155065 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.155030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf-webhook-cert\") pod \"maas-controller-6bc4c9f7b4-pp7bk\" (UID: \"a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf\") " pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:25:53.155255 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.155078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4txc\" (UniqueName: \"kubernetes.io/projected/a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf-kube-api-access-w4txc\") pod \"maas-controller-6bc4c9f7b4-pp7bk\" (UID: \"a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf\") " pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:25:53.255724 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.255685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4txc\" (UniqueName: \"kubernetes.io/projected/a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf-kube-api-access-w4txc\") pod \"maas-controller-6bc4c9f7b4-pp7bk\" (UID: \"a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf\") " pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:25:53.255891 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.255796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf-webhook-cert\") pod \"maas-controller-6bc4c9f7b4-pp7bk\" (UID: \"a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf\") " pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:25:53.258281 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.258255 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf-webhook-cert\") pod \"maas-controller-6bc4c9f7b4-pp7bk\" (UID: \"a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf\") " pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:25:53.263928 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.263907 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4txc\" (UniqueName: \"kubernetes.io/projected/a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf-kube-api-access-w4txc\") pod \"maas-controller-6bc4c9f7b4-pp7bk\" (UID: \"a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf\") " pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:25:53.339738 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.339707 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:25:53.473279 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:53.473256 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc4c9f7b4-pp7bk"] Jul 13 22:25:53.475453 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:25:53.475407 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b44cfb_a716_4d5c_9ff5_7a4f52fdcccf.slice/crio-c7197837d9eeff2222881d2dc7e9872553773f6f9b7cd93377d904a4082138a0 WatchSource:0}: Error finding container c7197837d9eeff2222881d2dc7e9872553773f6f9b7cd93377d904a4082138a0: Status 404 returned error can't find the container with id c7197837d9eeff2222881d2dc7e9872553773f6f9b7cd93377d904a4082138a0 Jul 13 22:25:54.218431 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:54.218323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" event={"ID":"a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf","Type":"ContainerStarted","Data":"7e4edc09620da62e80b791c693393d5145ce6230f061867ea4a83bbc236e6069"} Jul 13 22:25:54.218431 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:54.218378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" event={"ID":"a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf","Type":"ContainerStarted","Data":"c7197837d9eeff2222881d2dc7e9872553773f6f9b7cd93377d904a4082138a0"} Jul 13 22:25:54.218431 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:54.218402 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:25:54.234389 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:25:54.234336 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" podStartSLOduration=0.806279859 podStartE2EDuration="1.23431844s" totalImagesPullingTime="428.038581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:25:54.233853938 +0000 UTC m=+732.247850737" watchObservedRunningTime="2026-07-13 22:25:54.23431844 +0000 UTC m=+732.248315219" Jul 13 22:26:05.228242 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:26:05.228215 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc4c9f7b4-pp7bk" Jul 13 22:28:42.472618 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:28:42.472535 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:28:42.475050 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:28:42.472684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:30:00.146996 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.146956 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl"] Jul 13 22:30:00.151415 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.151386 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" Jul 13 22:30:00.153996 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.153977 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tgdl9\"" Jul 13 22:30:00.160982 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.160945 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl"] Jul 13 22:30:00.265269 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.265232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7bv\" (UniqueName: \"kubernetes.io/projected/58f1fc57-fe08-4e16-85cf-a869fe992a10-kube-api-access-xr7bv\") pod \"maas-api-key-cleanup-29733030-ltbfl\" (UID: \"58f1fc57-fe08-4e16-85cf-a869fe992a10\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" Jul 13 22:30:00.365934 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.365902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7bv\" (UniqueName: \"kubernetes.io/projected/58f1fc57-fe08-4e16-85cf-a869fe992a10-kube-api-access-xr7bv\") pod \"maas-api-key-cleanup-29733030-ltbfl\" (UID: \"58f1fc57-fe08-4e16-85cf-a869fe992a10\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" Jul 13 22:30:00.374076 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.374053 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7bv\" (UniqueName: \"kubernetes.io/projected/58f1fc57-fe08-4e16-85cf-a869fe992a10-kube-api-access-xr7bv\") pod \"maas-api-key-cleanup-29733030-ltbfl\" (UID: \"58f1fc57-fe08-4e16-85cf-a869fe992a10\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" Jul 13 22:30:00.463167 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.463095 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" Jul 13 22:30:00.594989 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.594967 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl"] Jul 13 22:30:00.597309 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:30:00.597278 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f1fc57_fe08_4e16_85cf_a869fe992a10.slice/crio-c1ec301dd0d22434aa290de064ec4ad333b603eadef8ba853e29edbcc71ddf4e WatchSource:0}: Error finding container c1ec301dd0d22434aa290de064ec4ad333b603eadef8ba853e29edbcc71ddf4e: Status 404 returned error can't find the container with id c1ec301dd0d22434aa290de064ec4ad333b603eadef8ba853e29edbcc71ddf4e Jul 13 22:30:00.599100 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:00.599080 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 22:30:01.449337 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:01.449298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" event={"ID":"58f1fc57-fe08-4e16-85cf-a869fe992a10","Type":"ContainerStarted","Data":"c1ec301dd0d22434aa290de064ec4ad333b603eadef8ba853e29edbcc71ddf4e"} Jul 13 22:30:03.462151 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:03.462114 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" event={"ID":"58f1fc57-fe08-4e16-85cf-a869fe992a10","Type":"ContainerStarted","Data":"b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e"} Jul 13 22:30:03.478744 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:30:03.478697 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" podStartSLOduration=0.994021115 podStartE2EDuration="3.478681731s" totalImagesPullingTime="2.484660616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:30:03.477325755 +0000 UTC m=+981.491322533" watchObservedRunningTime="2026-07-13 22:30:03.478681731 +0000 UTC m=+981.492678536" Jul 13 22:31:00.010994 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:00.010960 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl"] Jul 13 22:31:00.011585 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:00.011159 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" podUID="58f1fc57-fe08-4e16-85cf-a869fe992a10" containerName="cleanup" containerID="cri-o://b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e" gracePeriod=30 Jul 13 22:31:30.201473 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.201447 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" Jul 13 22:31:30.244144 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.244110 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr7bv\" (UniqueName: \"kubernetes.io/projected/58f1fc57-fe08-4e16-85cf-a869fe992a10-kube-api-access-xr7bv\") pod \"58f1fc57-fe08-4e16-85cf-a869fe992a10\" (UID: \"58f1fc57-fe08-4e16-85cf-a869fe992a10\") " Jul 13 22:31:30.246475 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.246449 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f1fc57-fe08-4e16-85cf-a869fe992a10-kube-api-access-xr7bv" (OuterVolumeSpecName: "kube-api-access-xr7bv") pod "58f1fc57-fe08-4e16-85cf-a869fe992a10" (UID: "58f1fc57-fe08-4e16-85cf-a869fe992a10"). InnerVolumeSpecName "kube-api-access-xr7bv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:31:30.345436 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.345397 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr7bv\" (UniqueName: \"kubernetes.io/projected/58f1fc57-fe08-4e16-85cf-a869fe992a10-kube-api-access-xr7bv\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:31:30.898175 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.898137 2577 generic.go:356] "Generic (PLEG): container finished" podID="58f1fc57-fe08-4e16-85cf-a869fe992a10" containerID="b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e" exitCode=137 Jul 13 22:31:30.898175 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.898174 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" Jul 13 22:31:30.898610 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.898221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" event={"ID":"58f1fc57-fe08-4e16-85cf-a869fe992a10","Type":"ContainerDied","Data":"b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e"} Jul 13 22:31:30.898610 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.898273 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl" event={"ID":"58f1fc57-fe08-4e16-85cf-a869fe992a10","Type":"ContainerDied","Data":"c1ec301dd0d22434aa290de064ec4ad333b603eadef8ba853e29edbcc71ddf4e"} Jul 13 22:31:30.898610 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.898295 2577 scope.go:117] "RemoveContainer" containerID="b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e" Jul 13 22:31:30.907121 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.907097 2577 scope.go:117] "RemoveContainer" containerID="b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e" Jul 13 22:31:30.907410 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:31:30.907390 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e\": container with ID starting with b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e not found: ID does not exist" containerID="b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e" Jul 13 22:31:30.907474 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.907435 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e"} err="failed to get container status \"b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e\": rpc error: code = NotFound desc = could not find container \"b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e\": container with ID starting with b4166329e09ef6c1ca446ed061d4a9b608d4867d79a2e3ada160834a52645f4e not found: ID does not exist" Jul 13 22:31:30.915147 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.915120 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl"] Jul 13 22:31:30.921047 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:30.921020 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733030-ltbfl"] Jul 13 22:31:32.566763 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:31:32.566670 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58f1fc57-fe08-4e16-85cf-a869fe992a10" path="/var/lib/kubelet/pods/58f1fc57-fe08-4e16-85cf-a869fe992a10/volumes" Jul 13 22:33:42.509926 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:33:42.509816 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:33:42.513744 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:33:42.512709 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:38:42.544240 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:38:42.544124 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:38:42.548700 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:38:42.548679 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:43:42.582862 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:43:42.582833 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:43:42.595069 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:43:42.595048 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:45:00.132733 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.132695 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4"] Jul 13 22:45:00.133217 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.133119 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f1fc57-fe08-4e16-85cf-a869fe992a10" containerName="cleanup" Jul 13 22:45:00.133217 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.133131 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f1fc57-fe08-4e16-85cf-a869fe992a10" containerName="cleanup" Jul 13 22:45:00.133217 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.133185 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="58f1fc57-fe08-4e16-85cf-a869fe992a10" containerName="cleanup" Jul 13 22:45:00.136092 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.136077 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv"] Jul 13 22:45:00.136205 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.136187 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" Jul 13 22:45:00.138747 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.138727 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tgdl9\"" Jul 13 22:45:00.139325 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.139311 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7"] Jul 13 22:45:00.139435 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.139412 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" Jul 13 22:45:00.142981 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.142961 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv"] Jul 13 22:45:00.143160 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.143028 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" Jul 13 22:45:00.147785 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.147757 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4"] Jul 13 22:45:00.152031 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.151995 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7"] Jul 13 22:45:00.201385 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.201359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f5sm\" (UniqueName: \"kubernetes.io/projected/54cbca9c-587a-44c5-a681-0876e3070804-kube-api-access-6f5sm\") pod \"maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4\" (UID: \"54cbca9c-587a-44c5-a681-0876e3070804\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" Jul 13 22:45:00.201545 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.201458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cglvt\" (UniqueName: \"kubernetes.io/projected/577faa3d-a549-4651-ad2d-81daed866544-kube-api-access-cglvt\") pod \"maas-api-key-cleanup-29733045-tptqv\" (UID: \"577faa3d-a549-4651-ad2d-81daed866544\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" Jul 13 22:45:00.201545 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.201510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnxdc\" (UniqueName: \"kubernetes.io/projected/eff3ffd2-20c0-4b24-9122-0cf7aef4f21f-kube-api-access-cnxdc\") pod \"maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7\" (UID: \"eff3ffd2-20c0-4b24-9122-0cf7aef4f21f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" Jul 13 22:45:00.302764 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.302733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglvt\" (UniqueName: \"kubernetes.io/projected/577faa3d-a549-4651-ad2d-81daed866544-kube-api-access-cglvt\") pod \"maas-api-key-cleanup-29733045-tptqv\" (UID: \"577faa3d-a549-4651-ad2d-81daed866544\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" Jul 13 22:45:00.302900 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.302773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnxdc\" (UniqueName: \"kubernetes.io/projected/eff3ffd2-20c0-4b24-9122-0cf7aef4f21f-kube-api-access-cnxdc\") pod \"maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7\" (UID: \"eff3ffd2-20c0-4b24-9122-0cf7aef4f21f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" Jul 13 22:45:00.302900 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.302889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f5sm\" (UniqueName: \"kubernetes.io/projected/54cbca9c-587a-44c5-a681-0876e3070804-kube-api-access-6f5sm\") pod \"maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4\" (UID: \"54cbca9c-587a-44c5-a681-0876e3070804\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" Jul 13 22:45:00.311648 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.311614 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f5sm\" (UniqueName: \"kubernetes.io/projected/54cbca9c-587a-44c5-a681-0876e3070804-kube-api-access-6f5sm\") pod \"maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4\" (UID: \"54cbca9c-587a-44c5-a681-0876e3070804\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" Jul 13 22:45:00.312205 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.312180 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnxdc\" (UniqueName: \"kubernetes.io/projected/eff3ffd2-20c0-4b24-9122-0cf7aef4f21f-kube-api-access-cnxdc\") pod \"maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7\" (UID: \"eff3ffd2-20c0-4b24-9122-0cf7aef4f21f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" Jul 13 22:45:00.312553 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.312531 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cglvt\" (UniqueName: \"kubernetes.io/projected/577faa3d-a549-4651-ad2d-81daed866544-kube-api-access-cglvt\") pod \"maas-api-key-cleanup-29733045-tptqv\" (UID: \"577faa3d-a549-4651-ad2d-81daed866544\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" Jul 13 22:45:00.456791 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.456709 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" Jul 13 22:45:00.466974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.466949 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" Jul 13 22:45:00.474067 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.474042 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" Jul 13 22:45:00.615864 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.615836 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4"] Jul 13 22:45:00.617844 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:45:00.617813 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54cbca9c_587a_44c5_a681_0876e3070804.slice/crio-8c91b307c23e8337acccccb770af32151f2c9b033598324abccdd699c281ba6a WatchSource:0}: Error finding container 8c91b307c23e8337acccccb770af32151f2c9b033598324abccdd699c281ba6a: Status 404 returned error can't find the container with id 8c91b307c23e8337acccccb770af32151f2c9b033598324abccdd699c281ba6a Jul 13 22:45:00.847301 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.847276 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7"] Jul 13 22:45:00.849252 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:45:00.849214 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff3ffd2_20c0_4b24_9122_0cf7aef4f21f.slice/crio-8a0b4a5b25ece0ab431da0d7120d468b0cb88de67db3351d327905394f9674ec WatchSource:0}: Error finding container 8a0b4a5b25ece0ab431da0d7120d468b0cb88de67db3351d327905394f9674ec: Status 404 returned error can't find the container with id 8a0b4a5b25ece0ab431da0d7120d468b0cb88de67db3351d327905394f9674ec Jul 13 22:45:00.850155 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.850033 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv"] Jul 13 22:45:00.852367 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:45:00.852332 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577faa3d_a549_4651_ad2d_81daed866544.slice/crio-eedc5840e2bfcc1c381c4da262f0f19bf88ec1adb2a04bcd431e2ca0a9a240be WatchSource:0}: Error finding container eedc5840e2bfcc1c381c4da262f0f19bf88ec1adb2a04bcd431e2ca0a9a240be: Status 404 returned error can't find the container with id eedc5840e2bfcc1c381c4da262f0f19bf88ec1adb2a04bcd431e2ca0a9a240be Jul 13 22:45:00.910792 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.910765 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" event={"ID":"577faa3d-a549-4651-ad2d-81daed866544","Type":"ContainerStarted","Data":"eedc5840e2bfcc1c381c4da262f0f19bf88ec1adb2a04bcd431e2ca0a9a240be"} Jul 13 22:45:00.911892 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.911865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" event={"ID":"eff3ffd2-20c0-4b24-9122-0cf7aef4f21f","Type":"ContainerStarted","Data":"8a0b4a5b25ece0ab431da0d7120d468b0cb88de67db3351d327905394f9674ec"} Jul 13 22:45:00.913274 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.913251 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" event={"ID":"54cbca9c-587a-44c5-a681-0876e3070804","Type":"ContainerStarted","Data":"07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2"} Jul 13 22:45:00.913355 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.913301 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" event={"ID":"54cbca9c-587a-44c5-a681-0876e3070804","Type":"ContainerStarted","Data":"8c91b307c23e8337acccccb770af32151f2c9b033598324abccdd699c281ba6a"} Jul 13 22:45:00.930182 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:00.930132 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" podStartSLOduration=0.930115243 podStartE2EDuration="930.115243ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:45:00.929709668 +0000 UTC m=+1878.943706448" watchObservedRunningTime="2026-07-13 22:45:00.930115243 +0000 UTC m=+1878.944112026" Jul 13 22:45:01.920276 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:01.920235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" event={"ID":"eff3ffd2-20c0-4b24-9122-0cf7aef4f21f","Type":"ContainerStarted","Data":"15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902"} Jul 13 22:45:01.921689 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:01.921662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" event={"ID":"577faa3d-a549-4651-ad2d-81daed866544","Type":"ContainerStarted","Data":"59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc"} Jul 13 22:45:01.938921 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:01.938872 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" podStartSLOduration=1.938856949 podStartE2EDuration="1.938856949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:45:01.937339659 +0000 UTC m=+1879.951336439" watchObservedRunningTime="2026-07-13 22:45:01.938856949 +0000 UTC m=+1879.952853766" Jul 13 22:45:22.116187 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:22.116127 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" podStartSLOduration=22.116110178 podStartE2EDuration="22.116110178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:45:01.956535508 +0000 UTC m=+1879.970532309" watchObservedRunningTime="2026-07-13 22:45:22.116110178 +0000 UTC m=+1900.130107005" Jul 13 22:45:22.116897 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:22.116877 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4"] Jul 13 22:45:22.117148 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:22.117120 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" podUID="54cbca9c-587a-44c5-a681-0876e3070804" containerName="cleanup" containerID="cri-o://07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2" gracePeriod=30 Jul 13 22:45:52.303482 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:52.303455 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" Jul 13 22:45:52.407564 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:52.407459 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f5sm\" (UniqueName: \"kubernetes.io/projected/54cbca9c-587a-44c5-a681-0876e3070804-kube-api-access-6f5sm\") pod \"54cbca9c-587a-44c5-a681-0876e3070804\" (UID: \"54cbca9c-587a-44c5-a681-0876e3070804\") " Jul 13 22:45:52.409680 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:52.409654 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54cbca9c-587a-44c5-a681-0876e3070804-kube-api-access-6f5sm" (OuterVolumeSpecName: "kube-api-access-6f5sm") pod "54cbca9c-587a-44c5-a681-0876e3070804" (UID: "54cbca9c-587a-44c5-a681-0876e3070804"). InnerVolumeSpecName "kube-api-access-6f5sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:45:52.508633 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:52.508593 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f5sm\" (UniqueName: \"kubernetes.io/projected/54cbca9c-587a-44c5-a681-0876e3070804-kube-api-access-6f5sm\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:45:53.175307 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:53.175265 2577 generic.go:356] "Generic (PLEG): container finished" podID="54cbca9c-587a-44c5-a681-0876e3070804" containerID="07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2" exitCode=137 Jul 13 22:45:53.175617 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:53.175313 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" Jul 13 22:45:53.175617 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:53.175312 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" event={"ID":"54cbca9c-587a-44c5-a681-0876e3070804","Type":"ContainerDied","Data":"07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2"} Jul 13 22:45:53.175617 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:53.175377 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4" event={"ID":"54cbca9c-587a-44c5-a681-0876e3070804","Type":"ContainerDied","Data":"8c91b307c23e8337acccccb770af32151f2c9b033598324abccdd699c281ba6a"} Jul 13 22:45:53.175617 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:53.175409 2577 scope.go:117] "RemoveContainer" containerID="07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2" Jul 13 22:45:53.184358 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:53.184338 2577 scope.go:117] "RemoveContainer" containerID="07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2" Jul 13 22:45:53.184631 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:45:53.184613 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2\": container with ID starting with 07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2 not found: ID does not exist" containerID="07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2" Jul 13 22:45:53.184677 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:53.184642 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2"} err="failed to get container status \"07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2\": rpc error: code = NotFound desc = could not find container \"07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2\": container with ID starting with 07f029f3178791cb694cd3b63cfdde7799a08cd869de0ac50e6062171ee49df2 not found: ID does not exist" Jul 13 22:45:53.192986 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:53.192964 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4"] Jul 13 22:45:53.198881 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:53.198856 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6e7f3c-29733045-rvpv4"] Jul 13 22:45:54.567013 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:45:54.566973 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54cbca9c-587a-44c5-a681-0876e3070804" path="/var/lib/kubelet/pods/54cbca9c-587a-44c5-a681-0876e3070804/volumes" Jul 13 22:46:00.010841 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:00.010806 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv"] Jul 13 22:46:00.011357 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:00.011002 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" podUID="577faa3d-a549-4651-ad2d-81daed866544" containerName="cleanup" containerID="cri-o://59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc" gracePeriod=30 Jul 13 22:46:00.013520 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:00.013495 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7"] Jul 13 22:46:00.013702 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:00.013669 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" podUID="eff3ffd2-20c0-4b24-9122-0cf7aef4f21f" containerName="cleanup" containerID="cri-o://15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902" gracePeriod=30 Jul 13 22:46:30.221651 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.221619 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" Jul 13 22:46:30.251543 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.251518 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" Jul 13 22:46:30.372653 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.372613 2577 generic.go:356] "Generic (PLEG): container finished" podID="577faa3d-a549-4651-ad2d-81daed866544" containerID="59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc" exitCode=137 Jul 13 22:46:30.372844 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.372660 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" Jul 13 22:46:30.372844 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.372697 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" event={"ID":"577faa3d-a549-4651-ad2d-81daed866544","Type":"ContainerDied","Data":"59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc"} Jul 13 22:46:30.372844 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.372751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv" event={"ID":"577faa3d-a549-4651-ad2d-81daed866544","Type":"ContainerDied","Data":"eedc5840e2bfcc1c381c4da262f0f19bf88ec1adb2a04bcd431e2ca0a9a240be"} Jul 13 22:46:30.372844 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.372775 2577 scope.go:117] "RemoveContainer" containerID="59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc" Jul 13 22:46:30.374144 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.374116 2577 generic.go:356] "Generic (PLEG): container finished" podID="eff3ffd2-20c0-4b24-9122-0cf7aef4f21f" containerID="15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902" exitCode=137 Jul 13 22:46:30.374326 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.374149 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" Jul 13 22:46:30.374326 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.374184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" event={"ID":"eff3ffd2-20c0-4b24-9122-0cf7aef4f21f","Type":"ContainerDied","Data":"15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902"} Jul 13 22:46:30.374326 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.374228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7" event={"ID":"eff3ffd2-20c0-4b24-9122-0cf7aef4f21f","Type":"ContainerDied","Data":"8a0b4a5b25ece0ab431da0d7120d468b0cb88de67db3351d327905394f9674ec"} Jul 13 22:46:30.377314 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.377296 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnxdc\" (UniqueName: \"kubernetes.io/projected/eff3ffd2-20c0-4b24-9122-0cf7aef4f21f-kube-api-access-cnxdc\") pod \"eff3ffd2-20c0-4b24-9122-0cf7aef4f21f\" (UID: \"eff3ffd2-20c0-4b24-9122-0cf7aef4f21f\") " Jul 13 22:46:30.377385 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.377372 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cglvt\" (UniqueName: \"kubernetes.io/projected/577faa3d-a549-4651-ad2d-81daed866544-kube-api-access-cglvt\") pod \"577faa3d-a549-4651-ad2d-81daed866544\" (UID: \"577faa3d-a549-4651-ad2d-81daed866544\") " Jul 13 22:46:30.379699 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.379675 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577faa3d-a549-4651-ad2d-81daed866544-kube-api-access-cglvt" (OuterVolumeSpecName: "kube-api-access-cglvt") pod "577faa3d-a549-4651-ad2d-81daed866544" (UID: "577faa3d-a549-4651-ad2d-81daed866544"). InnerVolumeSpecName "kube-api-access-cglvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:46:30.379798 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.379743 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eff3ffd2-20c0-4b24-9122-0cf7aef4f21f-kube-api-access-cnxdc" (OuterVolumeSpecName: "kube-api-access-cnxdc") pod "eff3ffd2-20c0-4b24-9122-0cf7aef4f21f" (UID: "eff3ffd2-20c0-4b24-9122-0cf7aef4f21f"). InnerVolumeSpecName "kube-api-access-cnxdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:46:30.383746 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.383726 2577 scope.go:117] "RemoveContainer" containerID="59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc" Jul 13 22:46:30.384026 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:46:30.384006 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc\": container with ID starting with 59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc not found: ID does not exist" containerID="59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc" Jul 13 22:46:30.384096 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.384039 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc"} err="failed to get container status \"59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc\": rpc error: code = NotFound desc = could not find container \"59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc\": container with ID starting with 59f74e9ebed73e7f5f178ecac1529a81e6b6f15aea79222376b56f19d05056fc not found: ID does not exist" Jul 13 22:46:30.384096 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.384063 2577 scope.go:117] "RemoveContainer" containerID="15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902" Jul 13 22:46:30.393622 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.393600 2577 scope.go:117] "RemoveContainer" containerID="15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902" Jul 13 22:46:30.393939 ip-10-0-132-225 kubenswrapper[2577]: E0713 22:46:30.393915 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902\": container with ID starting with 15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902 not found: ID does not exist" containerID="15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902" Jul 13 22:46:30.393991 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.393947 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902"} err="failed to get container status \"15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902\": rpc error: code = NotFound desc = could not find container \"15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902\": container with ID starting with 15136665938ba683c40ec3d48f0ca8e2907cf657be8ffde46e217d9f0573e902 not found: ID does not exist" Jul 13 22:46:30.478752 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.478716 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnxdc\" (UniqueName: \"kubernetes.io/projected/eff3ffd2-20c0-4b24-9122-0cf7aef4f21f-kube-api-access-cnxdc\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:46:30.478752 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.478747 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cglvt\" (UniqueName: \"kubernetes.io/projected/577faa3d-a549-4651-ad2d-81daed866544-kube-api-access-cglvt\") on node \"ip-10-0-132-225.ec2.internal\" DevicePath \"\"" Jul 13 22:46:30.717807 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.717720 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7"] Jul 13 22:46:30.729848 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.729809 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-953e38-29733045-cr8c7"] Jul 13 22:46:30.760470 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.760412 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv"] Jul 13 22:46:30.767802 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:30.767770 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733045-tptqv"] Jul 13 22:46:32.566630 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:32.566555 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="577faa3d-a549-4651-ad2d-81daed866544" path="/var/lib/kubelet/pods/577faa3d-a549-4651-ad2d-81daed866544/volumes" Jul 13 22:46:32.566986 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:46:32.566880 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eff3ffd2-20c0-4b24-9122-0cf7aef4f21f" path="/var/lib/kubelet/pods/eff3ffd2-20c0-4b24-9122-0cf7aef4f21f/volumes" Jul 13 22:48:42.619245 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:48:42.619132 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:48:42.629561 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:48:42.629542 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9f5l_1357a653-7f6f-4f90-b87f-30301c291f8e/ovn-acl-logging/0.log" Jul 13 22:50:24.245718 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:24.245680 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fc99b8fc-cm7s8_f568900a-7562-4efe-9b59-857e784bf3de/authorino/0.log" Jul 13 22:50:29.093020 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:29.092984 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bc4c9f7b4-pp7bk_a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf/manager/0.log" Jul 13 22:50:29.705992 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:29.705963 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5bf5468b-n58fh_023c09b6-4915-4960-a829-e264e04976dc/copy-manifests/0.log" Jul 13 22:50:29.712730 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:29.712698 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5bf5468b-n58fh_023c09b6-4915-4960-a829-e264e04976dc/manager/0.log" Jul 13 22:50:31.005436 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:31.005388 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fc99b8fc-cm7s8_f568900a-7562-4efe-9b59-857e784bf3de/authorino/0.log" Jul 13 22:50:32.417918 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:32.417879 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67f58f88b6-h487g_798ab651-34ac-4237-b6ef-989576d88a4f/kube-auth-proxy/0.log" Jul 13 22:50:32.659453 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:32.659406 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-79lf4_a4257814-a6e1-4567-aae6-c4ec997f7320/istio-proxy/1.log" Jul 13 22:50:32.905316 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:32.905271 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wnlxb_66c4cc5a-7380-4ff1-91b0-d67a1272c1c1/payload-processing/0.log" Jul 13 22:50:33.368694 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:33.368667 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-r949p_683a47e7-e1ca-460f-bb9b-17cb491f34b0/main/0.log" Jul 13 22:50:33.598739 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:33.598713 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6l59g_8fe27dce-7434-4de5-b1a4-42638a27c09f/main/0.log" Jul 13 22:50:41.040593 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:41.040562 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n9s5l_fbb4560a-0092-4378-b80b-d2d29109b1c8/global-pull-secret-syncer/0.log" Jul 13 22:50:41.137985 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:41.137952 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l69tt_1d75d3cd-0eb5-4cc1-ad0e-306d92c327f4/konnectivity-agent/0.log" Jul 13 22:50:41.209200 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:41.209164 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-225.ec2.internal_69e1b248276364992a05c6618a326633/haproxy/0.log" Jul 13 22:50:46.116783 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:46.116689 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fc99b8fc-cm7s8_f568900a-7562-4efe-9b59-857e784bf3de/authorino/0.log" Jul 13 22:50:48.257930 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.257903 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6cfb0c-2a15-470f-aed2-a6578c11260d/alertmanager/0.log" Jul 13 22:50:48.276698 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.276676 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6cfb0c-2a15-470f-aed2-a6578c11260d/config-reloader/0.log" Jul 13 22:50:48.294582 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.294557 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6cfb0c-2a15-470f-aed2-a6578c11260d/kube-rbac-proxy-web/0.log" Jul 13 22:50:48.316045 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.316013 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6cfb0c-2a15-470f-aed2-a6578c11260d/kube-rbac-proxy/0.log" Jul 13 22:50:48.336128 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.336099 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6cfb0c-2a15-470f-aed2-a6578c11260d/kube-rbac-proxy-metric/0.log" Jul 13 22:50:48.354379 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.354360 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6cfb0c-2a15-470f-aed2-a6578c11260d/prom-label-proxy/0.log" Jul 13 22:50:48.373850 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.373825 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6cfb0c-2a15-470f-aed2-a6578c11260d/init-config-reloader/0.log" Jul 13 22:50:48.463195 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.463165 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h82jw_8724ae8e-ba69-4a79-a970-3d3921b66da4/kube-state-metrics/0.log" Jul 13 22:50:48.477630 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.477603 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h82jw_8724ae8e-ba69-4a79-a970-3d3921b66da4/kube-rbac-proxy-main/0.log" Jul 13 22:50:48.496376 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.496354 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h82jw_8724ae8e-ba69-4a79-a970-3d3921b66da4/kube-rbac-proxy-self/0.log" Jul 13 22:50:48.525534 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.525507 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-84f9f7675-496pp_07efcc47-ed76-4efe-81a2-c062cce475ea/metrics-server/0.log" Jul 13 22:50:48.570862 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.570772 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-pm264_cc72a519-22a1-4ef6-b230-fd3608f5133e/monitoring-plugin/0.log" Jul 13 22:50:48.730821 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.730793 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nck77_0baa30ce-fb22-41fc-b1dc-3bee3612eaea/node-exporter/0.log" Jul 13 22:50:48.755562 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.755538 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nck77_0baa30ce-fb22-41fc-b1dc-3bee3612eaea/kube-rbac-proxy/0.log" Jul 13 22:50:48.773525 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.773494 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nck77_0baa30ce-fb22-41fc-b1dc-3bee3612eaea/init-textfile/0.log" Jul 13 22:50:48.806078 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.806054 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-kqxj5_b1c75bbe-9296-476f-ad8c-0a1e03f26c88/kube-rbac-proxy-main/0.log" Jul 13 22:50:48.825612 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.825534 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-kqxj5_b1c75bbe-9296-476f-ad8c-0a1e03f26c88/kube-rbac-proxy-self/0.log" Jul 13 22:50:48.843704 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.843682 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-kqxj5_b1c75bbe-9296-476f-ad8c-0a1e03f26c88/openshift-state-metrics/0.log" Jul 13 22:50:48.880552 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.880532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83201afd-d8a7-474a-b9c8-fce5b68234cc/prometheus/0.log" Jul 13 22:50:48.900795 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.900772 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83201afd-d8a7-474a-b9c8-fce5b68234cc/config-reloader/0.log" Jul 13 22:50:48.919775 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.919750 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83201afd-d8a7-474a-b9c8-fce5b68234cc/thanos-sidecar/0.log" Jul 13 22:50:48.938333 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.938305 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83201afd-d8a7-474a-b9c8-fce5b68234cc/kube-rbac-proxy-web/0.log" Jul 13 22:50:48.958559 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.958539 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83201afd-d8a7-474a-b9c8-fce5b68234cc/kube-rbac-proxy/0.log" Jul 13 22:50:48.981380 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:48.981167 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83201afd-d8a7-474a-b9c8-fce5b68234cc/kube-rbac-proxy-thanos/0.log" Jul 13 22:50:49.001460 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.001438 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83201afd-d8a7-474a-b9c8-fce5b68234cc/init-config-reloader/0.log" Jul 13 22:50:49.037546 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.037466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-lwxnd_33986edf-492a-444c-b32b-759898fd4d9f/prometheus-operator/0.log" Jul 13 22:50:49.053502 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.053474 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-lwxnd_33986edf-492a-444c-b32b-759898fd4d9f/kube-rbac-proxy/0.log" Jul 13 22:50:49.079136 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.079041 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-9jkhn_26198bc0-fa80-45d6-9c06-b3ee5cd4d22e/prometheus-operator-admission-webhook/0.log" Jul 13 22:50:49.106869 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.106829 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d5ffdd94-65wsn_6e8bb31c-076e-4e84-a40c-b5888e7eaa97/telemeter-client/0.log" Jul 13 22:50:49.129613 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.129582 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d5ffdd94-65wsn_6e8bb31c-076e-4e84-a40c-b5888e7eaa97/reload/0.log" Jul 13 22:50:49.151987 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.151960 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d5ffdd94-65wsn_6e8bb31c-076e-4e84-a40c-b5888e7eaa97/kube-rbac-proxy/0.log" Jul 13 22:50:49.188997 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.188972 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd4556dcd-pflwr_a6105de6-f7ad-42d6-a379-11daa8902783/thanos-query/0.log" Jul 13 22:50:49.211087 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.211057 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd4556dcd-pflwr_a6105de6-f7ad-42d6-a379-11daa8902783/kube-rbac-proxy-web/0.log" Jul 13 22:50:49.229533 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.229507 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd4556dcd-pflwr_a6105de6-f7ad-42d6-a379-11daa8902783/kube-rbac-proxy/0.log" Jul 13 22:50:49.252909 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.252885 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd4556dcd-pflwr_a6105de6-f7ad-42d6-a379-11daa8902783/prom-label-proxy/0.log" Jul 13 22:50:49.267729 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.267693 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd4556dcd-pflwr_a6105de6-f7ad-42d6-a379-11daa8902783/kube-rbac-proxy-rules/0.log" Jul 13 22:50:49.289291 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:49.289264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd4556dcd-pflwr_a6105de6-f7ad-42d6-a379-11daa8902783/kube-rbac-proxy-metrics/0.log" Jul 13 22:50:51.049117 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049080 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b"] Jul 13 22:50:51.049581 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049543 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cbca9c-587a-44c5-a681-0876e3070804" containerName="cleanup" Jul 13 22:50:51.049581 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049560 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cbca9c-587a-44c5-a681-0876e3070804" containerName="cleanup" Jul 13 22:50:51.049581 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049576 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577faa3d-a549-4651-ad2d-81daed866544" containerName="cleanup" Jul 13 22:50:51.049581 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049581 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="577faa3d-a549-4651-ad2d-81daed866544" containerName="cleanup" Jul 13 22:50:51.049778 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049595 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eff3ffd2-20c0-4b24-9122-0cf7aef4f21f" containerName="cleanup" Jul 13 22:50:51.049778 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049600 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eff3ffd2-20c0-4b24-9122-0cf7aef4f21f" containerName="cleanup" Jul 13 22:50:51.049778 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049689 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="577faa3d-a549-4651-ad2d-81daed866544" containerName="cleanup" Jul 13 22:50:51.049778 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049697 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="54cbca9c-587a-44c5-a681-0876e3070804" containerName="cleanup" Jul 13 22:50:51.049778 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.049704 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eff3ffd2-20c0-4b24-9122-0cf7aef4f21f" containerName="cleanup" Jul 13 22:50:51.052958 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.052930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.055376 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.055357 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g7vdh\"/\"openshift-service-ca.crt\"" Jul 13 22:50:51.056571 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.056551 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g7vdh\"/\"kube-root-ca.crt\"" Jul 13 22:50:51.056661 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.056560 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g7vdh\"/\"default-dockercfg-c6x79\"" Jul 13 22:50:51.061732 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.061713 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b"] Jul 13 22:50:51.154873 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.154839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-podres\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.155070 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.154892 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-proc\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.155070 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.154913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfvmp\" (UniqueName: \"kubernetes.io/projected/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-kube-api-access-wfvmp\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.155070 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.154998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-lib-modules\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.155070 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.155033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-sys\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.256493 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.256452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-lib-modules\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.256493 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.256493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-sys\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.256715 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.256551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-podres\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.256715 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.256585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-proc\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.256715 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.256610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfvmp\" (UniqueName: \"kubernetes.io/projected/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-kube-api-access-wfvmp\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.256715 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.256643 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-lib-modules\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.256715 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.256658 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-sys\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.256715 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.256673 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-proc\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.256715 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.256694 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-podres\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.264748 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.264722 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfvmp\" (UniqueName: \"kubernetes.io/projected/b0f6ff9b-f9f3-4872-a509-af68952a9ddf-kube-api-access-wfvmp\") pod \"perf-node-gather-daemonset-s577b\" (UID: \"b0f6ff9b-f9f3-4872-a509-af68952a9ddf\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.364703 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.364628 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.499103 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.499078 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b"] Jul 13 22:50:51.501258 ip-10-0-132-225 kubenswrapper[2577]: W0713 22:50:51.501227 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb0f6ff9b_f9f3_4872_a509_af68952a9ddf.slice/crio-d10a8bda864865cb42208121db7a74bd38bd9f4a92d514e752a696fcc8933138 WatchSource:0}: Error finding container d10a8bda864865cb42208121db7a74bd38bd9f4a92d514e752a696fcc8933138: Status 404 returned error can't find the container with id d10a8bda864865cb42208121db7a74bd38bd9f4a92d514e752a696fcc8933138 Jul 13 22:50:51.656093 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.655991 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" event={"ID":"b0f6ff9b-f9f3-4872-a509-af68952a9ddf","Type":"ContainerStarted","Data":"3fc0cf9f24b7136a11330bd9fa01782f90a1182153c58fdb0193c5b184ca6b63"} Jul 13 22:50:51.656093 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.656051 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" event={"ID":"b0f6ff9b-f9f3-4872-a509-af68952a9ddf","Type":"ContainerStarted","Data":"d10a8bda864865cb42208121db7a74bd38bd9f4a92d514e752a696fcc8933138"} Jul 13 22:50:51.656314 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.656152 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:51.672568 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:51.672512 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" podStartSLOduration=0.672491923 podStartE2EDuration="672.491923ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:50:51.671813937 +0000 UTC m=+2229.685810730" watchObservedRunningTime="2026-07-13 22:50:51.672491923 +0000 UTC m=+2229.686488702" Jul 13 22:50:53.396059 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:53.396032 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r8pbt_5d3bcba8-18a5-411e-a721-9b54cb862ff7/dns/0.log" Jul 13 22:50:53.414651 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:53.414603 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r8pbt_5d3bcba8-18a5-411e-a721-9b54cb862ff7/kube-rbac-proxy/0.log" Jul 13 22:50:53.502961 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:53.502931 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6cgjt_452df3a9-14cc-4ee1-95cf-76511cc4a922/dns-node-resolver/0.log" Jul 13 22:50:54.080441 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:54.080392 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9qzmj_914795a0-061c-487f-9c5c-6a281f3cb3cf/node-ca/0.log" Jul 13 22:50:55.336223 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:55.336182 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67f58f88b6-h487g_798ab651-34ac-4237-b6ef-989576d88a4f/kube-auth-proxy/0.log" Jul 13 22:50:55.387807 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:55.387779 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-79lf4_a4257814-a6e1-4567-aae6-c4ec997f7320/istio-proxy/0.log" Jul 13 22:50:55.443776 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:55.443744 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-79lf4_a4257814-a6e1-4567-aae6-c4ec997f7320/istio-proxy/1.log" Jul 13 22:50:55.565235 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:55.565207 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wnlxb_66c4cc5a-7380-4ff1-91b0-d67a1272c1c1/payload-processing/0.log" Jul 13 22:50:56.295374 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:56.295345 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8dbnr_ea1fae88-eb70-4e6d-932d-41c185e374d9/serve-healthcheck-canary/0.log" Jul 13 22:50:56.862827 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:56.862804 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fcgvn_ffe05c71-8f75-400c-8404-a50cf7807e14/kube-rbac-proxy/0.log" Jul 13 22:50:56.884590 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:56.884545 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fcgvn_ffe05c71-8f75-400c-8404-a50cf7807e14/exporter/0.log" Jul 13 22:50:56.904722 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:56.904699 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fcgvn_ffe05c71-8f75-400c-8404-a50cf7807e14/extractor/0.log" Jul 13 22:50:57.671289 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:57.671264 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-s577b" Jul 13 22:50:59.283019 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:59.282983 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bc4c9f7b4-pp7bk_a1b44cfb-a716-4d5c-9ff5-7a4f52fdcccf/manager/0.log" Jul 13 22:50:59.561974 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:59.561946 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5bf5468b-n58fh_023c09b6-4915-4960-a829-e264e04976dc/manager/0.log" Jul 13 22:50:59.583932 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:50:59.583906 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5bf5468b-n58fh_023c09b6-4915-4960-a829-e264e04976dc/copy-manifests/0.log" Jul 13 22:51:01.015133 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:01.015098 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84865b6cc-qnsv2_8218aa51-5402-4359-a6d6-8da6a982e57e/manager/0.log" Jul 13 22:51:01.043445 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:01.043404 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qqp84_e6b53cf0-a100-46fd-9e77-36295ae65e3c/openshift-lws-operator/0.log" Jul 13 22:51:01.433318 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:01.433289 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67f58f88b6-h487g_798ab651-34ac-4237-b6ef-989576d88a4f/kube-auth-proxy/0.log" Jul 13 22:51:01.470540 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:01.470511 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-79lf4_a4257814-a6e1-4567-aae6-c4ec997f7320/istio-proxy/0.log" Jul 13 22:51:01.526626 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:01.526592 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-79lf4_a4257814-a6e1-4567-aae6-c4ec997f7320/istio-proxy/1.log" Jul 13 22:51:01.632696 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:01.632657 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wnlxb_66c4cc5a-7380-4ff1-91b0-d67a1272c1c1/payload-processing/0.log" Jul 13 22:51:02.953946 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:02.953867 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67f58f88b6-h487g_798ab651-34ac-4237-b6ef-989576d88a4f/kube-auth-proxy/0.log" Jul 13 22:51:02.987161 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:02.987108 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-79lf4_a4257814-a6e1-4567-aae6-c4ec997f7320/istio-proxy/0.log" Jul 13 22:51:03.043043 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:03.043011 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-79lf4_a4257814-a6e1-4567-aae6-c4ec997f7320/istio-proxy/1.log" Jul 13 22:51:03.151614 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:03.151580 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wnlxb_66c4cc5a-7380-4ff1-91b0-d67a1272c1c1/payload-processing/0.log" Jul 13 22:51:07.381183 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:07.381156 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-26f7q_1452efde-f008-4841-872c-6476d32989d3/kube-multus/0.log" Jul 13 22:51:07.441696 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:07.441665 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-62x9l_050c6150-cc8d-485b-a2cb-d1024dc55a68/kube-multus-additional-cni-plugins/0.log" Jul 13 22:51:07.462059 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:07.462033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-62x9l_050c6150-cc8d-485b-a2cb-d1024dc55a68/egress-router-binary-copy/0.log" Jul 13 22:51:07.480596 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:07.480567 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-62x9l_050c6150-cc8d-485b-a2cb-d1024dc55a68/cni-plugins/0.log" Jul 13 22:51:07.499245 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:07.499223 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-62x9l_050c6150-cc8d-485b-a2cb-d1024dc55a68/bond-cni-plugin/0.log" Jul 13 22:51:07.520633 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:07.520611 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-62x9l_050c6150-cc8d-485b-a2cb-d1024dc55a68/routeoverride-cni/0.log" Jul 13 22:51:07.541571 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:07.541549 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-62x9l_050c6150-cc8d-485b-a2cb-d1024dc55a68/whereabouts-cni-bincopy/0.log" Jul 13 22:51:07.560798 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:07.560776 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-62x9l_050c6150-cc8d-485b-a2cb-d1024dc55a68/whereabouts-cni/0.log" Jul 13 22:51:08.023556 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:08.023521 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nkrpc_389f6223-7e84-4f59-9168-e6229907c56d/network-metrics-daemon/0.log" Jul 13 22:51:08.040029 ip-10-0-132-225 kubenswrapper[2577]: I0713 22:51:08.040003 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nkrpc_389f6223-7e84-4f59-9168-e6229907c56d/kube-rbac-proxy/0.log"