Jul 09 14:29:57.103600 ip-10-0-132-123 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 14:29:57.103611 ip-10-0-132-123 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 14:29:57.103620 ip-10-0-132-123 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 14:29:57.103953 ip-10-0-132-123 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 14:30:07.168658 ip-10-0-132-123 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 14:30:07.168673 ip-10-0-132-123 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 355f10d4842f4c3ca6e1113b10cbdd3c -- Jul 09 14:31:40.074081 ip-10-0-132-123 systemd[1]: Starting Kubernetes Kubelet... Jul 09 14:31:40.541021 ip-10-0-132-123 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:31:40.541021 ip-10-0-132-123 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 14:31:40.541021 ip-10-0-132-123 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:31:40.541021 ip-10-0-132-123 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 14:31:40.541021 ip-10-0-132-123 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:31:40.541021 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.535655 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544476 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544494 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544500 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544504 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544509 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544513 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544517 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544521 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544525 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544529 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544533 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544537 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544541 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544545 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544549 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544553 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544557 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544561 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:40.626085 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544565 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544568 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544572 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544578 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544581 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544585 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544589 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544593 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544600 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544616 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544624 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544630 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544635 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544639 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544644 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544649 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544653 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544658 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544662 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544666 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:40.628535 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544669 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:40.623950 ip-10-0-132-123 systemd[1]: Started Kubernetes Kubelet. Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544688 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544693 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544697 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544701 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544705 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544710 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544714 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544718 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544722 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544726 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544730 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544735 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544738 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544742 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544746 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544750 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544754 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544760 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544766 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:40.654985 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544770 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544775 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544779 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544783 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544787 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544792 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544796 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544801 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544805 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544809 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544813 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544817 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544821 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544825 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544829 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544833 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544837 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544841 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544845 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544848 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:40.658210 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544853 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544857 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544861 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544865 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544869 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544874 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544878 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544882 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544885 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544889 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544895 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544898 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544902 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544905 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544910 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544913 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544924 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544928 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544932 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544936 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:40.661555 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.544940 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.545965 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.545975 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.545980 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.545984 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.545987 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.545991 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.545996 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546001 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546005 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546009 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546014 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546018 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546022 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546026 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546031 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546035 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546039 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546044 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:40.833172 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546048 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546052 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546056 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546060 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546064 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546068 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546072 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546076 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546080 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546084 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546088 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546091 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546096 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546100 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546104 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546109 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546114 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546117 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546122 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546126 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:40.851602 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546130 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546134 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546138 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546142 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546149 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546154 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546158 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546161 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546165 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546169 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546173 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546177 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546182 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546186 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546190 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546194 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546198 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546202 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546206 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:40.852419 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546212 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546218 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546223 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546229 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546234 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546238 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546243 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546247 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546252 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546256 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546260 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546264 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546269 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546272 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546277 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546281 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546285 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546289 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546293 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546297 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:40.856224 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546301 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546305 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546309 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546313 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546316 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546321 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546326 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546330 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546337 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546341 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546345 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546348 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546352 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546356 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546360 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546364 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546369 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546374 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546379 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546382 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:40.857118 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546386 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546391 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546976 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546984 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546992 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.546996 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547000 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547004 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547008 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547011 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547015 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547020 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547024 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547028 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547032 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547036 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547040 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547044 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547049 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547053 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:40.857941 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547056 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547060 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547064 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547068 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547074 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547079 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547082 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547086 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547091 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547095 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547099 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547102 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547106 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547110 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547113 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547117 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547123 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547127 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547131 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547135 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:40.860020 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547139 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547143 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547146 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547150 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547156 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547161 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547166 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547170 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547175 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547179 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547183 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547188 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547192 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547196 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547203 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547208 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547213 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547218 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547222 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:40.860649 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547226 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547230 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547235 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547238 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547242 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547249 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547253 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547257 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547264 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547270 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547273 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547277 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547281 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547285 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547288 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547292 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547296 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547300 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547304 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547307 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:40.861900 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547311 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547315 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547319 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547322 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547326 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547331 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547334 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547338 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547343 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547346 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547350 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547354 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547358 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547362 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547366 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547369 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547373 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547378 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547383 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547387 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:40.862533 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547390 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.547395 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547488 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547498 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547508 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547519 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547525 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547530 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547536 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547542 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547546 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547551 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547556 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547561 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547566 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547570 2565 flags.go:64] FLAG: --cgroup-root="" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547574 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547578 2565 flags.go:64] FLAG: --client-ca-file="" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547583 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547587 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547593 2565 flags.go:64] FLAG: --cluster-domain="" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547597 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547602 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547606 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 14:31:40.863349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547610 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547616 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547620 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547625 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547630 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547636 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547640 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547645 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547650 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547656 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547662 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547666 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547670 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547692 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547698 2565 flags.go:64] FLAG: --enable-server="true" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547703 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547714 2565 flags.go:64] FLAG: --event-burst="100" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547719 2565 flags.go:64] FLAG: --event-qps="50" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547722 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547727 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547732 2565 flags.go:64] FLAG: --eviction-hard="" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547738 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547742 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547746 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547751 2565 flags.go:64] FLAG: --eviction-soft="" Jul 09 14:31:40.864096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547756 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547760 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547772 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547777 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547781 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547785 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547789 2565 flags.go:64] FLAG: --feature-gates="" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547795 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547800 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547804 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547809 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547813 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547819 2565 flags.go:64] FLAG: --help="false" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547823 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-132-123.ec2.internal" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547828 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547832 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547838 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547843 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547848 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547852 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547865 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547870 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547874 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 14:31:40.864805 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547878 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547883 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547887 2565 flags.go:64] FLAG: --kube-reserved="" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547891 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547895 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547900 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547904 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547908 2565 flags.go:64] FLAG: --lock-file="" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547912 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547917 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547922 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547930 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547935 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547939 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547943 2565 flags.go:64] FLAG: --logging-format="text" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547947 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547953 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547957 2565 flags.go:64] FLAG: --manifest-url="" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547962 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547968 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547972 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547980 2565 flags.go:64] FLAG: --max-pods="110" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547985 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547989 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547993 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 14:31:40.865489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.547999 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548004 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548008 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548012 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548023 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548028 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548032 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548036 2565 flags.go:64] FLAG: --pod-cidr="" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548041 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548049 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548053 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548058 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548062 2565 flags.go:64] FLAG: --port="10250" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548066 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548071 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bd8031f66636b627" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548076 2565 flags.go:64] FLAG: --qos-reserved="" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548080 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548085 2565 flags.go:64] FLAG: --register-node="true" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548090 2565 flags.go:64] FLAG: --register-with-taints="" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548095 2565 flags.go:64] FLAG: --registry-burst="10" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548100 2565 flags.go:64] FLAG: --registry-qps="5" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548105 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548109 2565 flags.go:64] FLAG: --reserved-memory="" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548115 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548120 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 14:31:40.866157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548124 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548128 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548133 2565 flags.go:64] FLAG: --runonce="false" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548137 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548143 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548147 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548151 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548157 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548162 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548166 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548171 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548174 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548178 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548183 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548188 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548192 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548197 2565 flags.go:64] FLAG: --system-cgroups="" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548201 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548209 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548213 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548217 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548227 2565 flags.go:64] FLAG: --tls-min-version="" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548231 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548235 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548240 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 14:31:40.866888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548244 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548248 2565 flags.go:64] FLAG: --v="2" Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548254 2565 flags.go:64] FLAG: --version="false" Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548262 2565 flags.go:64] FLAG: --vmodule="" Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548267 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.548273 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548433 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548441 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548446 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548450 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548454 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548460 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548463 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548467 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548474 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548478 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548482 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548486 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548489 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548494 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548498 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:40.867530 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548502 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548507 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548514 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548518 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548522 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548526 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548530 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548533 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548537 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548541 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548545 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548549 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548552 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548556 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548560 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548565 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548569 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548573 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548576 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548580 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:40.868171 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548584 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548588 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548594 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548599 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548602 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548608 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548611 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548615 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548619 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548623 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548627 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548631 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548635 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548639 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548643 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548646 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548651 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548654 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548658 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548662 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:40.868712 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548666 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548670 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548688 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548692 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548696 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548700 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548704 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548707 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548712 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548716 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548720 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548723 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548727 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548731 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548736 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548740 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548744 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548750 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548753 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548757 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:40.869423 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548761 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548765 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548769 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548772 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548776 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548780 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548784 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548791 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548796 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548800 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548803 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548807 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548811 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548814 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548818 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548822 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548826 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548830 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548834 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:40.870080 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548838 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548841 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548853 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548859 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.548864 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.549594 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.556755 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.556769 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.556783 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.556789 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556848 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556854 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556857 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556860 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:40.870958 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556864 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556867 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556869 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556872 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556877 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556881 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556884 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556887 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556890 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556893 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556896 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556899 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556902 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556905 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556908 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556910 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556913 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556924 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556930 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:40.872254 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556934 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556938 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556941 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556944 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556947 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556950 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556953 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556956 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556958 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556961 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556964 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556966 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556969 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556972 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556974 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556977 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556979 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556982 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556984 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556987 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:40.872865 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556989 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556992 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556994 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556997 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.556999 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557002 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557004 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557009 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557012 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557015 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557018 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557021 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557024 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557028 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557031 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557034 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557037 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557040 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557043 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:40.874331 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557046 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557049 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557052 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557055 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557057 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557060 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557063 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557065 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557068 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557070 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557073 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557076 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557078 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557081 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557083 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557085 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557088 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557091 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557093 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557096 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:40.874956 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557099 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557101 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557104 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557107 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557109 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557112 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557115 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557117 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557120 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557125 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557128 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557130 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557133 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557135 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557138 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557140 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:40.935633 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557143 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.557148 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557281 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557288 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557291 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557294 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557296 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557299 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557302 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557304 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557307 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557310 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557313 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557316 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:40.936383 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557318 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557321 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557324 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557327 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557329 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557332 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557334 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557338 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557341 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557344 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557347 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557356 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557360 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557363 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557366 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557369 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557371 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557374 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557376 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:40.936828 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557379 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557381 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557384 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557386 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557389 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557391 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557394 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557396 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557399 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557401 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557404 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557406 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557409 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557413 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557418 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557420 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557423 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557426 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557428 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:40.937404 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557431 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557433 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557436 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557438 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557440 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557443 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557454 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557457 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557459 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557462 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557465 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557467 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557469 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557472 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557474 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557477 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557480 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557482 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557484 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557487 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:40.938017 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557490 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557492 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557495 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557497 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557500 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557502 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557504 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557508 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557511 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557513 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557515 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557518 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557520 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557523 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557525 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557528 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557530 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557533 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557536 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557544 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:40.938700 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557548 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557552 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557555 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557557 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557560 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557563 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557565 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557568 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:40.557570 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.557576 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.557668 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.560130 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.561854 2565 server.go:1019] "Starting client certificate rotation" Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.561970 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:31:40.939257 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.562002 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:31:40.939665 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.565538 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:31:40.939665 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.567296 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:31:40.939665 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.585013 2565 log.go:25] "Validated CRI v1 runtime API" Jul 09 14:31:40.939665 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.587363 2565 log.go:25] "Validated CRI v1 image API" Jul 09 14:31:40.939665 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.588108 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 14:31:40.939665 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.590626 2565 fs.go:135] Filesystem UUIDs: map[2ebcd401-cc43-4db3-b301-4d44b861ecf5:/dev/nvme0n1p3 74f70b06-bfb3-4607-8880-dd3ba673a3d8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 14:31:40.939665 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.590646 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 14:31:40.939665 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.594333 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.595644 2565 manager.go:216] Machine: {Timestamp:2026-07-09 14:31:40.594164865 +0000 UTC m=+0.379008903 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100845 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec296f235b5bf74cc4aae00a3ee38a08 SystemUUID:ec296f23-5b5b-f74c-c4aa-e00a3ee38a08 BootID:355f10d4-842f-4c3c-a6e1-113b10cbdd3c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:88:60:1e:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:88:60:1e:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:fa:87:5a:90:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.595750 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.595828 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.598729 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.598755 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.599552 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.599565 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.599574 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.599588 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.601487 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.606115 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.606227 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.606252 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.606265 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.606278 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.606289 2565 kubelet.go:398] "Adding apiserver pod source" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.606299 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 14:31:40.940135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.606642 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.606661 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.608878 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.613328 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.613355 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.613525 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.613537 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.613543 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.613549 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.613557 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.613563 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.614202 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.614208 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.614219 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.614225 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.614238 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.614247 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.615701 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.615709 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.617906 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.618633 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.618636 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.618890 2565 server.go:1268] "Started kubelet" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.618976 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.618997 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.623053 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.624753 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.627302 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.628663 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.634499 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.634508 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.634603 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635237 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635242 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635256 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635355 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635365 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635651 2565 factory.go:55] Registering systemd factory Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635664 2565 factory.go:223] Registration of the systemd container factory successfully Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635866 2565 factory.go:153] Registering CRI-O factory Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635881 2565 factory.go:223] Registration of the crio container factory successfully Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635929 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635954 2565 factory.go:103] Registering Raw factory Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.635983 2565 manager.go:1196] Started watching for new ooms in manager Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.636423 2565 manager.go:349] Starting recovery of all containers Jul 09 14:31:40.940672 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.637794 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.638542 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.637634 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-123.ec2.internal.18c0a592651c1a9c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-123.ec2.internal,UID:ip-10-0-132-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-123.ec2.internal,},FirstTimestamp:2026-07-09 14:31:40.618865308 +0000 UTC m=+0.403709345,LastTimestamp:2026-07-09 14:31:40.618865308 +0000 UTC m=+0.403709345,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-123.ec2.internal,}" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.643486 2565 manager.go:354] Recovery completed Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.648585 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.650371 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.650399 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.650409 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.650559 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fhjlx" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.650909 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.650915 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.650917 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.650974 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.651527 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.651558 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.651567 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.655001 2565 policy_none.go:49] "None policy: Start" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.655019 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.655035 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.655011 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-123.ec2.internal.18c0a59266fd18bd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-123.ec2.internal,UID:ip-10-0-132-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-123.ec2.internal,},FirstTimestamp:2026-07-09 14:31:40.650387645 +0000 UTC m=+0.435231683,LastTimestamp:2026-07-09 14:31:40.650387645 +0000 UTC m=+0.435231683,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-123.ec2.internal,}" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.657124 2565 policy_none.go:47] "Start" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.658503 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fhjlx" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.666105 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-123.ec2.internal.18c0a59266fd58fd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-123.ec2.internal,UID:ip-10-0-132-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-123.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-123.ec2.internal,},FirstTimestamp:2026-07-09 14:31:40.650404093 +0000 UTC m=+0.435248131,LastTimestamp:2026-07-09 14:31:40.650404093 +0000 UTC m=+0.435248131,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-123.ec2.internal,}" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.709224 2565 manager.go:337] "Starting Device Plugin manager" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.709254 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.709263 2565 server.go:87] "Starting device plugin registration server" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.709510 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 14:31:40.941896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.709522 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.709643 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.709736 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.709749 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.710299 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.710338 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.728698 2565 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2601 into the system container \"/system.slice\": " Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.809637 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.810770 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.810796 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.810806 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.810831 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-123.ec2.internal" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.820379 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-123.ec2.internal" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.820400 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-123.ec2.internal\": node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.833593 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.834813 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.834858 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.834884 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.834924 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.839279 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.863404 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.935504 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal"] Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.935590 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.937336 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.937368 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.937378 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.939670 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.939790 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" Jul 09 14:31:40.942640 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.939827 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.946945 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.946953 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.946973 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.946987 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.946976 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.947057 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.949317 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.949339 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.957360 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.957383 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:40.957391 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.963817 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.994264 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-123.ec2.internal\" not found" node="ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:40.998371 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-123.ec2.internal\" not found" node="ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.036594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad3d36c070043dd6db6d4a5194d07329-config\") pod \"kube-apiserver-proxy-ip-10-0-132-123.ec2.internal\" (UID: \"ad3d36c070043dd6db6d4a5194d07329\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.036617 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee475eee2cc4e4319a99b8043bc5a81e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal\" (UID: \"ee475eee2cc4e4319a99b8043bc5a81e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.043128 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.036640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee475eee2cc4e4319a99b8043bc5a81e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal\" (UID: \"ee475eee2cc4e4319a99b8043bc5a81e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.206165 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.064862 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:41.206165 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.137208 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad3d36c070043dd6db6d4a5194d07329-config\") pod \"kube-apiserver-proxy-ip-10-0-132-123.ec2.internal\" (UID: \"ad3d36c070043dd6db6d4a5194d07329\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.206165 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.137238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad3d36c070043dd6db6d4a5194d07329-config\") pod \"kube-apiserver-proxy-ip-10-0-132-123.ec2.internal\" (UID: \"ad3d36c070043dd6db6d4a5194d07329\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.206165 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.137282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee475eee2cc4e4319a99b8043bc5a81e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal\" (UID: \"ee475eee2cc4e4319a99b8043bc5a81e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.206165 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.137302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee475eee2cc4e4319a99b8043bc5a81e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal\" (UID: \"ee475eee2cc4e4319a99b8043bc5a81e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.206165 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.137340 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee475eee2cc4e4319a99b8043bc5a81e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal\" (UID: \"ee475eee2cc4e4319a99b8043bc5a81e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.206165 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.137369 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee475eee2cc4e4319a99b8043bc5a81e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal\" (UID: \"ee475eee2cc4e4319a99b8043bc5a81e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.206165 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.165261 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:41.360548 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.266008 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:41.360548 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.297164 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.360548 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.302548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal" Jul 09 14:31:41.539281 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.366611 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:41.539281 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.467705 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:41.713643 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.561209 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 14:31:41.713643 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.561354 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:31:41.713643 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.567885 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:41.713643 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.663406 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:26:41 +0000 UTC" deadline="2027-12-02 19:17:36.011270692 +0000 UTC" Jul 09 14:31:41.713643 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.663440 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12268h45m54.347834516s" Jul 09 14:31:41.713643 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.668961 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:41.874404 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.771286 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:41.874404 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.826696 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:31:41.874404 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.873249 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:42.047350 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:41.888727 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:31:42.047350 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:41.974153 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:42.224701 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.074959 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-123.ec2.internal\" not found" Jul 09 14:31:42.224701 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.099557 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:31:42.224701 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.134743 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" Jul 09 14:31:42.224701 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.151226 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:31:42.224701 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.153845 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal" Jul 09 14:31:42.224701 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.165806 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:31:42.326437 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.326402 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee475eee2cc4e4319a99b8043bc5a81e.slice/crio-b5e79d42c89c08c519f8cd38b675d19f88cf8fa14a899853083aa06f361a3aea WatchSource:0}: Error finding container b5e79d42c89c08c519f8cd38b675d19f88cf8fa14a899853083aa06f361a3aea: Status 404 returned error can't find the container with id b5e79d42c89c08c519f8cd38b675d19f88cf8fa14a899853083aa06f361a3aea Jul 09 14:31:42.333587 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.333567 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:31:42.336910 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.336875 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3d36c070043dd6db6d4a5194d07329.slice/crio-c5293517a451144376d17d6d4a74173a66544fdca935778f7e38ed0eb4cdb048 WatchSource:0}: Error finding container c5293517a451144376d17d6d4a74173a66544fdca935778f7e38ed0eb4cdb048: Status 404 returned error can't find the container with id c5293517a451144376d17d6d4a74173a66544fdca935778f7e38ed0eb4cdb048 Jul 09 14:31:42.440629 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.440596 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:31:42.607404 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.607328 2565 apiserver.go:52] "Watching apiserver" Jul 09 14:31:42.616443 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.616426 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 14:31:42.616856 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.616836 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pc8dz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s","openshift-dns/node-resolver-znhx8","openshift-image-registry/node-ca-dmlkq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal","openshift-multus/multus-additional-cni-plugins-x6727","openshift-network-operator/iptables-alerter-ds8qb","openshift-ovn-kubernetes/ovnkube-node-zt4vr","kube-system/konnectivity-agent-zdbtf","kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kqmb7","openshift-multus/multus-nkqcz","openshift-multus/network-metrics-daemon-5979f","openshift-network-diagnostics/network-check-target-78fcz"] Jul 09 14:31:42.619766 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.619751 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.622050 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.622033 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.623084 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.623065 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 14:31:42.623306 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.623288 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:31:42.623555 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.623535 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 14:31:42.623642 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.623540 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6tzjv\"" Jul 09 14:31:42.624268 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.624254 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.625093 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.625075 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 14:31:42.625158 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.625093 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:31:42.625158 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.625107 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b6cn5\"" Jul 09 14:31:42.627179 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.627162 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t42p7\"" Jul 09 14:31:42.627321 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.627301 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 14:31:42.627412 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.627396 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 14:31:42.627910 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.627890 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.630278 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.630262 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:42.630361 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.630321 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:31:42.630857 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.630835 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 14:31:42.630929 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.630859 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 14:31:42.630993 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.630984 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 14:31:42.631070 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.631051 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mrg22\"" Jul 09 14:31:42.632711 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.632675 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.635800 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.635779 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 14:31:42.635978 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.635961 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 14:31:42.636306 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.636179 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 14:31:42.636306 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.636194 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 14:31:42.636953 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.636648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:42.636953 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.636664 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 14:31:42.636953 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.636834 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 14:31:42.637190 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.637173 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5jkqd\"" Jul 09 14:31:42.639188 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.639157 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:42.639294 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.639232 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:31:42.639781 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.639740 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 14:31:42.639871 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.639835 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 14:31:42.639987 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.639973 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nr2dv\"" Jul 09 14:31:42.641639 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.641615 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.644116 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.644096 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.645562 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-sysconfig\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.645660 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-sysctl-conf\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.645660 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645592 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-run\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.645660 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fswbw\" (UniqueName: \"kubernetes.io/projected/87d03eb3-1fe1-4f4f-9108-9774099ddc01-kube-api-access-fswbw\") pod \"iptables-alerter-ds8qb\" (UID: \"87d03eb3-1fe1-4f4f-9108-9774099ddc01\") " pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.645660 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj4cd\" (UniqueName: \"kubernetes.io/projected/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-kube-api-access-jj4cd\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.645660 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/927ddcb4-5717-487e-a54a-9ebd9e52ab87-agent-certs\") pod \"konnectivity-agent-zdbtf\" (UID: \"927ddcb4-5717-487e-a54a-9ebd9e52ab87\") " pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:42.645883 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd56578a-50aa-4c05-98eb-f918768d2392-hosts-file\") pod \"node-resolver-znhx8\" (UID: \"dd56578a-50aa-4c05-98eb-f918768d2392\") " pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.645883 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-lib-modules\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.645883 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c1e4313-4e21-44e1-9752-9b74c71737ac-tmp\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.645883 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd56578a-50aa-4c05-98eb-f918768d2392-tmp-dir\") pod \"node-resolver-znhx8\" (UID: \"dd56578a-50aa-4c05-98eb-f918768d2392\") " pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.645883 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-sysctl-d\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.645883 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-host\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.645883 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmdb6\" (UniqueName: \"kubernetes.io/projected/890717d4-da1d-4362-a06d-ee3c6bf0197d-kube-api-access-bmdb6\") pod \"node-ca-dmlkq\" (UID: \"890717d4-da1d-4362-a06d-ee3c6bf0197d\") " pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-system-cni-dir\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645911 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-cni-binary-copy\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/927ddcb4-5717-487e-a54a-9ebd9e52ab87-konnectivity-ca\") pod \"konnectivity-agent-zdbtf\" (UID: \"927ddcb4-5717-487e-a54a-9ebd9e52ab87\") " pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-modprobe-d\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.645988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/890717d4-da1d-4362-a06d-ee3c6bf0197d-host\") pod \"node-ca-dmlkq\" (UID: \"890717d4-da1d-4362-a06d-ee3c6bf0197d\") " pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/890717d4-da1d-4362-a06d-ee3c6bf0197d-serviceca\") pod \"node-ca-dmlkq\" (UID: \"890717d4-da1d-4362-a06d-ee3c6bf0197d\") " pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-os-release\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-kubernetes\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.646134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g96g7\" (UniqueName: \"kubernetes.io/projected/8c1e4313-4e21-44e1-9752-9b74c71737ac-kube-api-access-g96g7\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-cnibin\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-systemd\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-sys\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-tuned\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9s8\" (UniqueName: \"kubernetes.io/projected/dd56578a-50aa-4c05-98eb-f918768d2392-kube-api-access-jz9s8\") pod \"node-resolver-znhx8\" (UID: \"dd56578a-50aa-4c05-98eb-f918768d2392\") " pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-var-lib-kubelet\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87d03eb3-1fe1-4f4f-9108-9774099ddc01-iptables-alerter-script\") pod \"iptables-alerter-ds8qb\" (UID: \"87d03eb3-1fe1-4f4f-9108-9774099ddc01\") " pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87d03eb3-1fe1-4f4f-9108-9774099ddc01-host-slash\") pod \"iptables-alerter-ds8qb\" (UID: \"87d03eb3-1fe1-4f4f-9108-9774099ddc01\") " pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.646586 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646595 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 14:31:42.646627 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646631 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 14:31:42.647270 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646646 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4bjpr\"" Jul 09 14:31:42.647270 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646664 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 14:31:42.647270 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646671 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 14:31:42.647270 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.646826 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 14:31:42.647270 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.647008 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 14:31:42.647270 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.647093 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 14:31:42.647270 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.647123 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kx2hk\"" Jul 09 14:31:42.649366 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.649346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.652393 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.652378 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 14:31:42.652484 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.652439 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 14:31:42.652618 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.652599 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 14:31:42.652618 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.652620 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8s8q8\"" Jul 09 14:31:42.653921 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.653903 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:31:42.679267 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.679251 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zghz6" Jul 09 14:31:42.688289 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.688270 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zghz6" Jul 09 14:31:42.736645 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.736623 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 14:31:42.746711 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-hostroot\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.746776 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-etc-kubernetes\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.746776 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz7dn\" (UniqueName: \"kubernetes.io/projected/380db035-1473-4b1b-b5c6-0b36dd2145e4-kube-api-access-pz7dn\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.746839 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-modprobe-d\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.746839 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/890717d4-da1d-4362-a06d-ee3c6bf0197d-host\") pod \"node-ca-dmlkq\" (UID: \"890717d4-da1d-4362-a06d-ee3c6bf0197d\") " pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.746905 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746834 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-os-release\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.746905 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-cni-netd\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.746905 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746887 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/890717d4-da1d-4362-a06d-ee3c6bf0197d-host\") pod \"node-ca-dmlkq\" (UID: \"890717d4-da1d-4362-a06d-ee3c6bf0197d\") " pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.746997 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-sys-fs\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.746997 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746926 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-modprobe-d\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.746997 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:42.746997 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746952 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-os-release\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.746997 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a84b571e-13fd-4648-b24c-8e23722e4f7a-kubelet-config\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:42.746997 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.746992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-var-lib-openvswitch\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-run-ovn\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747069 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-cni-bin\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-cnibin\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-systemd\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-sys\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-registration-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-run-multus-certs\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747199 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-sys\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747207 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-systemd\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.747219 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87d03eb3-1fe1-4f4f-9108-9774099ddc01-iptables-alerter-script\") pod \"iptables-alerter-ds8qb\" (UID: \"87d03eb3-1fe1-4f4f-9108-9774099ddc01\") " pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqm9g\" (UniqueName: \"kubernetes.io/projected/b7e3791a-647d-4eba-a8e7-820a07879e4e-kube-api-access-vqm9g\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-cni-dir\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-var-lib-kubelet\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-run\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747383 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-run\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj4cd\" (UniqueName: \"kubernetes.io/projected/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-kube-api-access-jj4cd\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-var-lib-cni-multus\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd56578a-50aa-4c05-98eb-f918768d2392-hosts-file\") pod \"node-resolver-znhx8\" (UID: \"dd56578a-50aa-4c05-98eb-f918768d2392\") " pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-slash\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-run-netns\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-etc-openvswitch\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747522 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd56578a-50aa-4c05-98eb-f918768d2392-hosts-file\") pod \"node-resolver-znhx8\" (UID: \"dd56578a-50aa-4c05-98eb-f918768d2392\") " pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd56578a-50aa-4c05-98eb-f918768d2392-tmp-dir\") pod \"node-resolver-znhx8\" (UID: \"dd56578a-50aa-4c05-98eb-f918768d2392\") " pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-systemd-units\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-run-openvswitch\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.747684 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-device-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747744 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-os-release\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-sysctl-d\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747784 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-host\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmdb6\" (UniqueName: \"kubernetes.io/projected/890717d4-da1d-4362-a06d-ee3c6bf0197d-kube-api-access-bmdb6\") pod \"node-ca-dmlkq\" (UID: \"890717d4-da1d-4362-a06d-ee3c6bf0197d\") " pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-system-cni-dir\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747868 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd56578a-50aa-4c05-98eb-f918768d2392-tmp-dir\") pod \"node-resolver-znhx8\" (UID: \"dd56578a-50aa-4c05-98eb-f918768d2392\") " pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747873 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87d03eb3-1fe1-4f4f-9108-9774099ddc01-iptables-alerter-script\") pod \"iptables-alerter-ds8qb\" (UID: \"87d03eb3-1fe1-4f4f-9108-9774099ddc01\") " pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747891 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-host\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747904 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-sysctl-d\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747914 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-system-cni-dir\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-cni-binary-copy\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/927ddcb4-5717-487e-a54a-9ebd9e52ab87-konnectivity-ca\") pod \"konnectivity-agent-zdbtf\" (UID: \"927ddcb4-5717-487e-a54a-9ebd9e52ab87\") " pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-kubelet\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.747992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:42.748456 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748017 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/890717d4-da1d-4362-a06d-ee3c6bf0197d-serviceca\") pod \"node-ca-dmlkq\" (UID: \"890717d4-da1d-4362-a06d-ee3c6bf0197d\") " pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-socket-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-run-k8s-cni-cncf-io\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-conf-dir\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-kubernetes\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g96g7\" (UniqueName: \"kubernetes.io/projected/8c1e4313-4e21-44e1-9752-9b74c71737ac-kube-api-access-g96g7\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-cnibin\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748210 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-kubernetes\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-tuned\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9s8\" (UniqueName: \"kubernetes.io/projected/dd56578a-50aa-4c05-98eb-f918768d2392-kube-api-access-jz9s8\") pod \"node-resolver-znhx8\" (UID: \"dd56578a-50aa-4c05-98eb-f918768d2392\") " pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748264 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-cnibin\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-run-systemd\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748219 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-node-log\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748316 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-cni-binary-copy\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748325 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-ovnkube-script-lib\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.749202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-system-cni-dir\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-run-netns\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-var-lib-kubelet\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748447 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87d03eb3-1fe1-4f4f-9108-9774099ddc01-host-slash\") pod \"iptables-alerter-ds8qb\" (UID: \"87d03eb3-1fe1-4f4f-9108-9774099ddc01\") " pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748467 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-var-lib-kubelet\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-socket-dir-parent\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748506 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87d03eb3-1fe1-4f4f-9108-9774099ddc01-host-slash\") pod \"iptables-alerter-ds8qb\" (UID: \"87d03eb3-1fe1-4f4f-9108-9774099ddc01\") " pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-var-lib-cni-bin\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748530 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748538 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/927ddcb4-5717-487e-a54a-9ebd9e52ab87-konnectivity-ca\") pod \"konnectivity-agent-zdbtf\" (UID: \"927ddcb4-5717-487e-a54a-9ebd9e52ab87\") " pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748540 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/890717d4-da1d-4362-a06d-ee3c6bf0197d-serviceca\") pod \"node-ca-dmlkq\" (UID: \"890717d4-da1d-4362-a06d-ee3c6bf0197d\") " pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-sysconfig\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-sysctl-conf\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fswbw\" (UniqueName: \"kubernetes.io/projected/87d03eb3-1fe1-4f4f-9108-9774099ddc01-kube-api-access-fswbw\") pod \"iptables-alerter-ds8qb\" (UID: \"87d03eb3-1fe1-4f4f-9108-9774099ddc01\") " pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748609 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-sysconfig\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/927ddcb4-5717-487e-a54a-9ebd9e52ab87-agent-certs\") pod \"konnectivity-agent-zdbtf\" (UID: \"927ddcb4-5717-487e-a54a-9ebd9e52ab87\") " pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748725 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-sysctl-conf\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748757 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-log-socket\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.749792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz7q5\" (UniqueName: \"kubernetes.io/projected/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-kube-api-access-xz7q5\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-ovnkube-config\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h9dj\" (UniqueName: \"kubernetes.io/projected/4a89dae6-1243-4a06-bb11-568474c70bf1-kube-api-access-5h9dj\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-daemon-config\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-lib-modules\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c1e4313-4e21-44e1-9752-9b74c71737ac-tmp\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a84b571e-13fd-4648-b24c-8e23722e4f7a-dbus\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-env-overrides\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748985 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c1e4313-4e21-44e1-9752-9b74c71737ac-lib-modules\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.748994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-ovn-node-metrics-cert\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.749042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.749073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.749105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.749133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/380db035-1473-4b1b-b5c6-0b36dd2145e4-cni-binary-copy\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.750349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.749642 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.751594 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.751577 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c1e4313-4e21-44e1-9752-9b74c71737ac-etc-tuned\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.751881 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.751848 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/927ddcb4-5717-487e-a54a-9ebd9e52ab87-agent-certs\") pod \"konnectivity-agent-zdbtf\" (UID: \"927ddcb4-5717-487e-a54a-9ebd9e52ab87\") " pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:42.752294 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.752277 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c1e4313-4e21-44e1-9752-9b74c71737ac-tmp\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.756492 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.756474 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:31:42.756591 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.756493 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:31:42.756591 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.756512 2565 projected.go:196] Error preparing data for projected volume kube-api-access-qgmqs for pod openshift-network-diagnostics/network-check-target-78fcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:42.756591 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.756581 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs podName:e7eacb00-a29f-45fb-af2c-d3dbdf94db09 nodeName:}" failed. No retries permitted until 2026-07-09 14:31:43.256550038 +0000 UTC m=+3.041394064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qgmqs" (UniqueName: "kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs") pod "network-check-target-78fcz" (UID: "e7eacb00-a29f-45fb-af2c-d3dbdf94db09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:42.758488 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.758461 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g96g7\" (UniqueName: \"kubernetes.io/projected/8c1e4313-4e21-44e1-9752-9b74c71737ac-kube-api-access-g96g7\") pod \"tuned-kqmb7\" (UID: \"8c1e4313-4e21-44e1-9752-9b74c71737ac\") " pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.758691 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.758673 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmdb6\" (UniqueName: \"kubernetes.io/projected/890717d4-da1d-4362-a06d-ee3c6bf0197d-kube-api-access-bmdb6\") pod \"node-ca-dmlkq\" (UID: \"890717d4-da1d-4362-a06d-ee3c6bf0197d\") " pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.758959 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.758940 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fswbw\" (UniqueName: \"kubernetes.io/projected/87d03eb3-1fe1-4f4f-9108-9774099ddc01-kube-api-access-fswbw\") pod \"iptables-alerter-ds8qb\" (UID: \"87d03eb3-1fe1-4f4f-9108-9774099ddc01\") " pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.759165 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.759148 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9s8\" (UniqueName: \"kubernetes.io/projected/dd56578a-50aa-4c05-98eb-f918768d2392-kube-api-access-jz9s8\") pod \"node-resolver-znhx8\" (UID: \"dd56578a-50aa-4c05-98eb-f918768d2392\") " pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.759944 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.759925 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj4cd\" (UniqueName: \"kubernetes.io/projected/12055efe-4e0c-4d22-9dfb-4bea12beaa7c-kube-api-access-jj4cd\") pod \"multus-additional-cni-plugins-x6727\" (UID: \"12055efe-4e0c-4d22-9dfb-4bea12beaa7c\") " pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.845886 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.845827 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" event={"ID":"ee475eee2cc4e4319a99b8043bc5a81e","Type":"ContainerStarted","Data":"b5e79d42c89c08c519f8cd38b675d19f88cf8fa14a899853083aa06f361a3aea"} Jul 09 14:31:42.846881 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.846858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal" event={"ID":"ad3d36c070043dd6db6d4a5194d07329","Type":"ContainerStarted","Data":"c5293517a451144376d17d6d4a74173a66544fdca935778f7e38ed0eb4cdb048"} Jul 09 14:31:42.850412 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-registration-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.850459 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850421 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-run-multus-certs\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.850459 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850441 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850554 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm9g\" (UniqueName: \"kubernetes.io/projected/b7e3791a-647d-4eba-a8e7-820a07879e4e-kube-api-access-vqm9g\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:42.850554 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-cni-dir\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.850554 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850514 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-var-lib-kubelet\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.850554 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850521 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-registration-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.850554 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850528 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-run-multus-certs\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850571 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-var-lib-cni-multus\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-var-lib-cni-multus\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850526 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850583 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-var-lib-kubelet\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850605 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-slash\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-run-netns\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-etc-openvswitch\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850648 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-slash\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-systemd-units\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850674 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-cni-dir\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850706 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-run-netns\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-run-openvswitch\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850724 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-run-openvswitch\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850742 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-systemd-units\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850752 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-etc-openvswitch\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.850835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850838 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-device-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-os-release\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850905 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-kubelet\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850917 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-device-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850957 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-kubelet\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850985 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-os-release\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.850959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-socket-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-run-k8s-cni-cncf-io\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.851048 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-conf-dir\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851093 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-socket-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.851116 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs podName:b7e3791a-647d-4eba-a8e7-820a07879e4e nodeName:}" failed. No retries permitted until 2026-07-09 14:31:43.351096485 +0000 UTC m=+3.135940533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs") pod "network-metrics-daemon-5979f" (UID: "b7e3791a-647d-4eba-a8e7-820a07879e4e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851128 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-conf-dir\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-run-systemd\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851154 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-run-k8s-cni-cncf-io\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.851651 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-node-log\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-run-systemd\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-ovnkube-script-lib\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-system-cni-dir\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851287 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-node-log\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851288 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-system-cni-dir\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-run-netns\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-socket-dir-parent\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-var-lib-cni-bin\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851371 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-run-netns\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-log-socket\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851414 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-host-var-lib-cni-bin\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851414 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7q5\" (UniqueName: \"kubernetes.io/projected/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-kube-api-access-xz7q5\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851431 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-socket-dir-parent\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851468 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-log-socket\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851832 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-ovnkube-script-lib\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-ovnkube-config\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9dj\" (UniqueName: \"kubernetes.io/projected/4a89dae6-1243-4a06-bb11-568474c70bf1-kube-api-access-5h9dj\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.852553 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851975 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-daemon-config\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.851994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a84b571e-13fd-4648-b24c-8e23722e4f7a-dbus\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-env-overrides\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852035 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-ovn-node-metrics-cert\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/380db035-1473-4b1b-b5c6-0b36dd2145e4-cni-binary-copy\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-hostroot\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-etc-kubernetes\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852269 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852285 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a84b571e-13fd-4648-b24c-8e23722e4f7a-dbus\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852398 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz7dn\" (UniqueName: \"kubernetes.io/projected/380db035-1473-4b1b-b5c6-0b36dd2145e4-kube-api-access-pz7dn\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-cni-netd\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-sys-fs\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a84b571e-13fd-4648-b24c-8e23722e4f7a-kubelet-config\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852543 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:42.853383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852555 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-hostroot\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-var-lib-openvswitch\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-run-ovn\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852602 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-etc-kubernetes\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852638 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-cni-bin\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-cnibin\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852677 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-cni-netd\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852513 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-env-overrides\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/380db035-1473-4b1b-b5c6-0b36dd2145e4-multus-daemon-config\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852644 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-run-ovn\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852708 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-ovnkube-config\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852760 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-host-cni-bin\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852789 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a84b571e-13fd-4648-b24c-8e23722e4f7a-kubelet-config\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852794 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a89dae6-1243-4a06-bb11-568474c70bf1-sys-fs\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852839 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-var-lib-openvswitch\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852843 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/380db035-1473-4b1b-b5c6-0b36dd2145e4-cnibin\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.852864 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.852882 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/380db035-1473-4b1b-b5c6-0b36dd2145e4-cni-binary-copy\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.854150 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:42.852933 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret podName:a84b571e-13fd-4648-b24c-8e23722e4f7a nodeName:}" failed. No retries permitted until 2026-07-09 14:31:43.352896397 +0000 UTC m=+3.137740426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret") pod "global-pull-secret-syncer-pc8dz" (UID: "a84b571e-13fd-4648-b24c-8e23722e4f7a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:42.854723 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.854436 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-ovn-node-metrics-cert\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.860653 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.860579 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqm9g\" (UniqueName: \"kubernetes.io/projected/b7e3791a-647d-4eba-a8e7-820a07879e4e-kube-api-access-vqm9g\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:42.861995 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.861971 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h9dj\" (UniqueName: \"kubernetes.io/projected/4a89dae6-1243-4a06-bb11-568474c70bf1-kube-api-access-5h9dj\") pod \"aws-ebs-csi-driver-node-mwt7s\" (UID: \"4a89dae6-1243-4a06-bb11-568474c70bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.862194 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.862176 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz7q5\" (UniqueName: \"kubernetes.io/projected/4bfdb2d6-4c5e-476a-8d63-43b25e66940a-kube-api-access-xz7q5\") pod \"ovnkube-node-zt4vr\" (UID: \"4bfdb2d6-4c5e-476a-8d63-43b25e66940a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.862385 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.862369 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz7dn\" (UniqueName: \"kubernetes.io/projected/380db035-1473-4b1b-b5c6-0b36dd2145e4-kube-api-access-pz7dn\") pod \"multus-nkqcz\" (UID: \"380db035-1473-4b1b-b5c6-0b36dd2145e4\") " pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.930589 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.930558 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ds8qb" Jul 09 14:31:42.939492 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.939464 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" Jul 09 14:31:42.941337 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.941310 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d03eb3_1fe1_4f4f_9108_9774099ddc01.slice/crio-3f14cb71389335fd5127e85271d3cdd750dc94f4b9ebf178249f00d81c7548eb WatchSource:0}: Error finding container 3f14cb71389335fd5127e85271d3cdd750dc94f4b9ebf178249f00d81c7548eb: Status 404 returned error can't find the container with id 3f14cb71389335fd5127e85271d3cdd750dc94f4b9ebf178249f00d81c7548eb Jul 09 14:31:42.947503 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.947480 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znhx8" Jul 09 14:31:42.950420 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.950389 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1e4313_4e21_44e1_9752_9b74c71737ac.slice/crio-3b56840b0dcdf3453f7b4302dc2f0488370172f8b82bbdcf0a56a838512f4b13 WatchSource:0}: Error finding container 3b56840b0dcdf3453f7b4302dc2f0488370172f8b82bbdcf0a56a838512f4b13: Status 404 returned error can't find the container with id 3b56840b0dcdf3453f7b4302dc2f0488370172f8b82bbdcf0a56a838512f4b13 Jul 09 14:31:42.951355 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.951334 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dmlkq" Jul 09 14:31:42.957689 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.957666 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x6727" Jul 09 14:31:42.960910 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.960823 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd56578a_50aa_4c05_98eb_f918768d2392.slice/crio-13366db0d2fc2ec93ec39d92893d96aef3888857c213f7b0e00feaf8b397fffd WatchSource:0}: Error finding container 13366db0d2fc2ec93ec39d92893d96aef3888857c213f7b0e00feaf8b397fffd: Status 404 returned error can't find the container with id 13366db0d2fc2ec93ec39d92893d96aef3888857c213f7b0e00feaf8b397fffd Jul 09 14:31:42.962306 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.962287 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:42.963991 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.963967 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890717d4_da1d_4362_a06d_ee3c6bf0197d.slice/crio-aff0323e7e53155dd654d3e9d89a67ddfff304c003fcdb0e84b4a2892c15ffb9 WatchSource:0}: Error finding container aff0323e7e53155dd654d3e9d89a67ddfff304c003fcdb0e84b4a2892c15ffb9: Status 404 returned error can't find the container with id aff0323e7e53155dd654d3e9d89a67ddfff304c003fcdb0e84b4a2892c15ffb9 Jul 09 14:31:42.968686 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.968667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:31:42.970054 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.970031 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12055efe_4e0c_4d22_9dfb_4bea12beaa7c.slice/crio-40e71d9bff34feb7c84ec832620d41bd6b71077f746b0123e24c446ec7dca4ed WatchSource:0}: Error finding container 40e71d9bff34feb7c84ec832620d41bd6b71077f746b0123e24c446ec7dca4ed: Status 404 returned error can't find the container with id 40e71d9bff34feb7c84ec832620d41bd6b71077f746b0123e24c446ec7dca4ed Jul 09 14:31:42.973767 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.973744 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nkqcz" Jul 09 14:31:42.973993 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.973967 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927ddcb4_5717_487e_a54a_9ebd9e52ab87.slice/crio-0ec52e06159e195036fec7821ad225accfdbdc953a17edc88a584d744dfefc9d WatchSource:0}: Error finding container 0ec52e06159e195036fec7821ad225accfdbdc953a17edc88a584d744dfefc9d: Status 404 returned error can't find the container with id 0ec52e06159e195036fec7821ad225accfdbdc953a17edc88a584d744dfefc9d Jul 09 14:31:42.979215 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:42.979064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" Jul 09 14:31:42.980475 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.980452 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfdb2d6_4c5e_476a_8d63_43b25e66940a.slice/crio-5b0bef0ca1d109418457398deaf908f8f801b244d49206ee9cf1df7aaefc0c03 WatchSource:0}: Error finding container 5b0bef0ca1d109418457398deaf908f8f801b244d49206ee9cf1df7aaefc0c03: Status 404 returned error can't find the container with id 5b0bef0ca1d109418457398deaf908f8f801b244d49206ee9cf1df7aaefc0c03 Jul 09 14:31:42.992426 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:31:42.992402 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a89dae6_1243_4a06_bb11_568474c70bf1.slice/crio-8fba2136bac8af3c49181e70f0e30bee1d9c44a560f05090fb27f872c4e27725 WatchSource:0}: Error finding container 8fba2136bac8af3c49181e70f0e30bee1d9c44a560f05090fb27f872c4e27725: Status 404 returned error can't find the container with id 8fba2136bac8af3c49181e70f0e30bee1d9c44a560f05090fb27f872c4e27725 Jul 09 14:31:43.357298 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.357177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:43.357298 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.357258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:43.357529 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.357309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:43.357529 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:43.357471 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:43.357632 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:43.357551 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret podName:a84b571e-13fd-4648-b24c-8e23722e4f7a nodeName:}" failed. No retries permitted until 2026-07-09 14:31:44.357531314 +0000 UTC m=+4.142375356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret") pod "global-pull-secret-syncer-pc8dz" (UID: "a84b571e-13fd-4648-b24c-8e23722e4f7a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:43.357632 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:43.357477 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:43.357748 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:43.357657 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs podName:b7e3791a-647d-4eba-a8e7-820a07879e4e nodeName:}" failed. No retries permitted until 2026-07-09 14:31:44.357635488 +0000 UTC m=+4.142479514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs") pod "network-metrics-daemon-5979f" (UID: "b7e3791a-647d-4eba-a8e7-820a07879e4e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:43.357988 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:43.357972 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:31:43.358033 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:43.358013 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:31:43.358033 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:43.358028 2565 projected.go:196] Error preparing data for projected volume kube-api-access-qgmqs for pod openshift-network-diagnostics/network-check-target-78fcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:43.358111 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:43.358082 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs podName:e7eacb00-a29f-45fb-af2c-d3dbdf94db09 nodeName:}" failed. No retries permitted until 2026-07-09 14:31:44.358065846 +0000 UTC m=+4.142909875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qgmqs" (UniqueName: "kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs") pod "network-check-target-78fcz" (UID: "e7eacb00-a29f-45fb-af2c-d3dbdf94db09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:43.692086 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.691760 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:26:43 +0000 UTC" deadline="2028-04-03 13:20:32.09842326 +0000 UTC" Jul 09 14:31:43.692086 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.692040 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15214h48m48.406389358s" Jul 09 14:31:43.858377 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.858341 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zdbtf" event={"ID":"927ddcb4-5717-487e-a54a-9ebd9e52ab87","Type":"ContainerStarted","Data":"0ec52e06159e195036fec7821ad225accfdbdc953a17edc88a584d744dfefc9d"} Jul 09 14:31:43.865672 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.865623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerStarted","Data":"40e71d9bff34feb7c84ec832620d41bd6b71077f746b0123e24c446ec7dca4ed"} Jul 09 14:31:43.869973 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.869934 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" event={"ID":"8c1e4313-4e21-44e1-9752-9b74c71737ac","Type":"ContainerStarted","Data":"3b56840b0dcdf3453f7b4302dc2f0488370172f8b82bbdcf0a56a838512f4b13"} Jul 09 14:31:43.881914 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.881889 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ds8qb" event={"ID":"87d03eb3-1fe1-4f4f-9108-9774099ddc01","Type":"ContainerStarted","Data":"3f14cb71389335fd5127e85271d3cdd750dc94f4b9ebf178249f00d81c7548eb"} Jul 09 14:31:43.895048 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.895019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" event={"ID":"4a89dae6-1243-4a06-bb11-568474c70bf1","Type":"ContainerStarted","Data":"8fba2136bac8af3c49181e70f0e30bee1d9c44a560f05090fb27f872c4e27725"} Jul 09 14:31:43.904507 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.904477 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nkqcz" event={"ID":"380db035-1473-4b1b-b5c6-0b36dd2145e4","Type":"ContainerStarted","Data":"dfe9ed4f4c239cd35de5cd260b456b001564b332a91f3509bda5cd039dd635d0"} Jul 09 14:31:43.908138 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.908110 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerStarted","Data":"5b0bef0ca1d109418457398deaf908f8f801b244d49206ee9cf1df7aaefc0c03"} Jul 09 14:31:43.922954 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.922923 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dmlkq" event={"ID":"890717d4-da1d-4362-a06d-ee3c6bf0197d","Type":"ContainerStarted","Data":"aff0323e7e53155dd654d3e9d89a67ddfff304c003fcdb0e84b4a2892c15ffb9"} Jul 09 14:31:43.951073 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:43.950727 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znhx8" event={"ID":"dd56578a-50aa-4c05-98eb-f918768d2392","Type":"ContainerStarted","Data":"13366db0d2fc2ec93ec39d92893d96aef3888857c213f7b0e00feaf8b397fffd"} Jul 09 14:31:44.367338 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:44.367255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:44.367338 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:44.367333 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:44.367574 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:44.367363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:44.367574 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.367501 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:44.367574 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.367560 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret podName:a84b571e-13fd-4648-b24c-8e23722e4f7a nodeName:}" failed. No retries permitted until 2026-07-09 14:31:46.367541709 +0000 UTC m=+6.152385737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret") pod "global-pull-secret-syncer-pc8dz" (UID: "a84b571e-13fd-4648-b24c-8e23722e4f7a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:44.368000 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.367981 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:44.368091 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.368037 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs podName:b7e3791a-647d-4eba-a8e7-820a07879e4e nodeName:}" failed. No retries permitted until 2026-07-09 14:31:46.368021406 +0000 UTC m=+6.152865438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs") pod "network-metrics-daemon-5979f" (UID: "b7e3791a-647d-4eba-a8e7-820a07879e4e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:44.368161 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.368126 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:31:44.368161 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.368145 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:31:44.368161 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.368157 2565 projected.go:196] Error preparing data for projected volume kube-api-access-qgmqs for pod openshift-network-diagnostics/network-check-target-78fcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:44.368311 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.368194 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs podName:e7eacb00-a29f-45fb-af2c-d3dbdf94db09 nodeName:}" failed. No retries permitted until 2026-07-09 14:31:46.368182527 +0000 UTC m=+6.153026568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qgmqs" (UniqueName: "kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs") pod "network-check-target-78fcz" (UID: "e7eacb00-a29f-45fb-af2c-d3dbdf94db09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:44.692829 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:44.692722 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:26:43 +0000 UTC" deadline="2028-01-20 05:22:01.639803275 +0000 UTC" Jul 09 14:31:44.692829 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:44.692759 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13430h50m16.947048707s" Jul 09 14:31:44.836924 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:44.836889 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:44.837121 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:44.836930 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:44.837121 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:44.836897 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:44.837121 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.837044 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:31:44.837294 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.837141 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:31:44.837294 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:44.837231 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:31:46.386863 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:46.386820 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:46.386863 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:46.386866 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:46.387439 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:46.386921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:46.387439 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.387024 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:31:46.387439 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.387051 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:31:46.387439 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.387065 2565 projected.go:196] Error preparing data for projected volume kube-api-access-qgmqs for pod openshift-network-diagnostics/network-check-target-78fcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:46.387439 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.387098 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:46.387439 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.387128 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs podName:e7eacb00-a29f-45fb-af2c-d3dbdf94db09 nodeName:}" failed. No retries permitted until 2026-07-09 14:31:50.387107209 +0000 UTC m=+10.171951254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qgmqs" (UniqueName: "kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs") pod "network-check-target-78fcz" (UID: "e7eacb00-a29f-45fb-af2c-d3dbdf94db09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:46.387439 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.387152 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:46.387439 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.387165 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret podName:a84b571e-13fd-4648-b24c-8e23722e4f7a nodeName:}" failed. No retries permitted until 2026-07-09 14:31:50.387145963 +0000 UTC m=+10.171990009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret") pod "global-pull-secret-syncer-pc8dz" (UID: "a84b571e-13fd-4648-b24c-8e23722e4f7a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:46.387439 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.387206 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs podName:b7e3791a-647d-4eba-a8e7-820a07879e4e nodeName:}" failed. No retries permitted until 2026-07-09 14:31:50.387188863 +0000 UTC m=+10.172032904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs") pod "network-metrics-daemon-5979f" (UID: "b7e3791a-647d-4eba-a8e7-820a07879e4e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:46.836315 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:46.836236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:46.836315 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:46.836286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:46.836533 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:46.836236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:46.836533 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.836396 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:31:46.836533 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.836514 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:31:46.836695 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:46.836599 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:31:48.835836 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:48.835800 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:48.836359 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:48.835959 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:31:48.836359 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:48.836220 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:48.836359 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:48.836340 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:31:48.836548 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:48.836416 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:48.836548 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:48.836524 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:31:50.422957 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:50.422908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:50.422982 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:50.423037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.423079 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.423190 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret podName:a84b571e-13fd-4648-b24c-8e23722e4f7a nodeName:}" failed. No retries permitted until 2026-07-09 14:31:58.423163569 +0000 UTC m=+18.208007670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret") pod "global-pull-secret-syncer-pc8dz" (UID: "a84b571e-13fd-4648-b24c-8e23722e4f7a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.423214 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.423232 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.423298 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs podName:b7e3791a-647d-4eba-a8e7-820a07879e4e nodeName:}" failed. No retries permitted until 2026-07-09 14:31:58.423277493 +0000 UTC m=+18.208121543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs") pod "network-metrics-daemon-5979f" (UID: "b7e3791a-647d-4eba-a8e7-820a07879e4e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.423236 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.423328 2565 projected.go:196] Error preparing data for projected volume kube-api-access-qgmqs for pod openshift-network-diagnostics/network-check-target-78fcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:50.423455 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.423373 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs podName:e7eacb00-a29f-45fb-af2c-d3dbdf94db09 nodeName:}" failed. No retries permitted until 2026-07-09 14:31:58.423360756 +0000 UTC m=+18.208204799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qgmqs" (UniqueName: "kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs") pod "network-check-target-78fcz" (UID: "e7eacb00-a29f-45fb-af2c-d3dbdf94db09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:50.836421 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:50.836339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:50.836583 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:50.836458 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:50.836583 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.836488 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:31:50.836583 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.836560 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:31:50.836807 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:50.836590 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:50.836807 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:50.836739 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:31:52.835879 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:52.835838 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:52.836278 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:52.835978 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:31:52.836360 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:52.836344 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:52.836493 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:52.836449 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:31:52.836722 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:52.836512 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:52.836722 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:52.836619 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:31:54.835217 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:54.835174 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:54.835576 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:54.835174 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:54.835576 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:54.835292 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:54.835576 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:54.835290 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:31:54.835576 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:54.835389 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:31:54.835576 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:54.835455 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:31:55.981285 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:55.981203 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal" event={"ID":"ad3d36c070043dd6db6d4a5194d07329","Type":"ContainerStarted","Data":"b32a56130041aeda74af4ef6bb3643465f37e1d9994464efea0cbbf5bec453ee"} Jul 09 14:31:55.982876 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:55.982846 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zdbtf" event={"ID":"927ddcb4-5717-487e-a54a-9ebd9e52ab87","Type":"ContainerStarted","Data":"83312b8a124e563615e02b4efa2f753a68d6986e5aae20fdd9fb2581ed77e1ca"} Jul 09 14:31:55.984349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:55.984324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerStarted","Data":"fd035652e793a339b96522b8297e17bf119ad027795092242b735e69572c1bf7"} Jul 09 14:31:56.001213 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:56.001161 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-123.ec2.internal" podStartSLOduration=14.001148276 podStartE2EDuration="14.001148276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:31:56.0010674 +0000 UTC m=+15.785911478" watchObservedRunningTime="2026-07-09 14:31:56.001148276 +0000 UTC m=+15.785992323" Jul 09 14:31:56.019896 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:56.019854 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zdbtf" podStartSLOduration=3.236498737 podStartE2EDuration="15.019841334s" totalImagesPullingTime="11.783342597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:31:56.019240826 +0000 UTC m=+15.804084871" watchObservedRunningTime="2026-07-09 14:31:56.019841334 +0000 UTC m=+15.804685381" Jul 09 14:31:56.835694 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:56.835655 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:56.835857 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:56.835655 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:56.835857 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:56.835797 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:31:56.835980 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:56.835874 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:31:56.835980 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:56.835655 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:56.835980 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:56.835954 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:31:56.987669 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:56.987623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ds8qb" event={"ID":"87d03eb3-1fe1-4f4f-9108-9774099ddc01","Type":"ContainerStarted","Data":"bca0e3bb9d226029bc606f12c44eb2ab810bb75a0deb0f7e00a0090f7bab5670"} Jul 09 14:31:57.007740 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:57.007661 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ds8qb" podStartSLOduration=4.124651849 podStartE2EDuration="16.007644508s" totalImagesPullingTime="11.882992659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:31:57.007225228 +0000 UTC m=+16.792069274" watchObservedRunningTime="2026-07-09 14:31:57.007644508 +0000 UTC m=+16.792488557" Jul 09 14:31:58.487948 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:58.487715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:58.487988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:58.488008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.487861 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.488096 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs podName:b7e3791a-647d-4eba-a8e7-820a07879e4e nodeName:}" failed. No retries permitted until 2026-07-09 14:32:14.488074138 +0000 UTC m=+34.272918180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs") pod "network-metrics-daemon-5979f" (UID: "b7e3791a-647d-4eba-a8e7-820a07879e4e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.488157 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.488164 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.488173 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.488186 2565 projected.go:196] Error preparing data for projected volume kube-api-access-qgmqs for pod openshift-network-diagnostics/network-check-target-78fcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.488216 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret podName:a84b571e-13fd-4648-b24c-8e23722e4f7a nodeName:}" failed. No retries permitted until 2026-07-09 14:32:14.488200633 +0000 UTC m=+34.273044691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret") pod "global-pull-secret-syncer-pc8dz" (UID: "a84b571e-13fd-4648-b24c-8e23722e4f7a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:31:58.488416 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.488235 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs podName:e7eacb00-a29f-45fb-af2c-d3dbdf94db09 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:14.488226145 +0000 UTC m=+34.273070174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qgmqs" (UniqueName: "kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs") pod "network-check-target-78fcz" (UID: "e7eacb00-a29f-45fb-af2c-d3dbdf94db09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:31:58.836144 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:58.836060 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:31:58.836144 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:58.836109 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:31:58.836359 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:58.836060 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:31:58.836359 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.836192 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:31:58.836359 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.836289 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:31:58.836524 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:31:58.836373 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:31:58.926772 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:58.926732 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:58.927560 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:58.927535 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:31:59.995411 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:59.995379 2565 generic.go:356] "Generic (PLEG): container finished" podID="12055efe-4e0c-4d22-9dfb-4bea12beaa7c" containerID="fd035652e793a339b96522b8297e17bf119ad027795092242b735e69572c1bf7" exitCode=0 Jul 09 14:31:59.995955 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:31:59.995424 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerDied","Data":"fd035652e793a339b96522b8297e17bf119ad027795092242b735e69572c1bf7"} Jul 09 14:32:00.836281 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:00.836248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:00.836455 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:00.836333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:00.836455 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:00.836347 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:32:00.836566 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:00.836477 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:32:00.836566 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:00.836510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:00.836695 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:00.836621 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:32:02.835880 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:02.835840 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:02.835880 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:02.835861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:02.836497 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:02.835843 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:02.836497 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:02.835989 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:32:02.836497 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:02.836118 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:32:02.836497 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:02.836205 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:32:04.004998 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.004601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" event={"ID":"4a89dae6-1243-4a06-bb11-568474c70bf1","Type":"ContainerStarted","Data":"03fca3c31d6c918151595fe15230b14e0e634275d6b832e7430924dbef03001f"} Jul 09 14:32:04.006406 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.006380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nkqcz" event={"ID":"380db035-1473-4b1b-b5c6-0b36dd2145e4","Type":"ContainerStarted","Data":"5700a98f74b987f5442ea602f0ca1592b5649cf8e9ef8536b8de4ceeb377c7c9"} Jul 09 14:32:04.009255 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.009232 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt4vr_4bfdb2d6-4c5e-476a-8d63-43b25e66940a/ovn-acl-logging/0.log" Jul 09 14:32:04.009598 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.009574 2565 generic.go:356] "Generic (PLEG): container finished" podID="4bfdb2d6-4c5e-476a-8d63-43b25e66940a" containerID="173a9e31cfd39a92b2535a41c936e629155ee914a73b26f931d790300bd23e9f" exitCode=1 Jul 09 14:32:04.009671 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.009645 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerStarted","Data":"4559319e89c4c799549a2cf95f51f6849f606dffb89ff4b8ecddbd2cdcd210df"} Jul 09 14:32:04.009749 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.009734 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerStarted","Data":"76976e80e70b3ea838df1affce06f7e9c129dabb6cfb20bbf34a4bf6bb3b1d9a"} Jul 09 14:32:04.009804 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.009768 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerStarted","Data":"0946b2ecdb1f6e6e454dc463a77bcf6d8a8ed2221b11d7d5e879d4b8544cfaa2"} Jul 09 14:32:04.009860 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.009814 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerStarted","Data":"cb44eab123d35fc856e69e82b8b789fd8ae66a4d19946a61c5ee24f9341181e9"} Jul 09 14:32:04.009915 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.009863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerDied","Data":"173a9e31cfd39a92b2535a41c936e629155ee914a73b26f931d790300bd23e9f"} Jul 09 14:32:04.009915 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.009911 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerStarted","Data":"3a7646b891849c92759cccc9f9f04263fbcf455cb1c881b17beda44e5cf0db0b"} Jul 09 14:32:04.011181 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.011153 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dmlkq" event={"ID":"890717d4-da1d-4362-a06d-ee3c6bf0197d","Type":"ContainerStarted","Data":"c8ad4165f6fc5b33f15aad6a4f95f5f21b2db8fd3e8c5bed1fd15bdbafddeac2"} Jul 09 14:32:04.012615 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.012586 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znhx8" event={"ID":"dd56578a-50aa-4c05-98eb-f918768d2392","Type":"ContainerStarted","Data":"120921cc1ac32d98832ca1964c3a9e5475886895f537a32ccc3e5a494bb52f30"} Jul 09 14:32:04.014167 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.014147 2565 generic.go:356] "Generic (PLEG): container finished" podID="ee475eee2cc4e4319a99b8043bc5a81e" containerID="2a9b3d8387e62b1c7cebfd80afdd75b9db182562001e32b4dfa85e472f56cdad" exitCode=0 Jul 09 14:32:04.014276 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.014230 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" event={"ID":"ee475eee2cc4e4319a99b8043bc5a81e","Type":"ContainerDied","Data":"2a9b3d8387e62b1c7cebfd80afdd75b9db182562001e32b4dfa85e472f56cdad"} Jul 09 14:32:04.015693 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.015656 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" event={"ID":"8c1e4313-4e21-44e1-9752-9b74c71737ac","Type":"ContainerStarted","Data":"d7346074413d25cf7d98243ee8dc5d82f517d6f1b01c29374986a0784b8b4942"} Jul 09 14:32:04.027550 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.027501 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nkqcz" podStartSLOduration=2.918451105 podStartE2EDuration="23.027485145s" totalImagesPullingTime="20.10903404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:04.026694708 +0000 UTC m=+23.811538754" watchObservedRunningTime="2026-07-09 14:32:04.027485145 +0000 UTC m=+23.812329190" Jul 09 14:32:04.045058 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.045026 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-znhx8" podStartSLOduration=11.177148535 podStartE2EDuration="23.045015308s" totalImagesPullingTime="11.867866773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:04.044879636 +0000 UTC m=+23.829723683" watchObservedRunningTime="2026-07-09 14:32:04.045015308 +0000 UTC m=+23.829859354" Jul 09 14:32:04.080036 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.079989 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dmlkq" podStartSLOduration=11.218875308 podStartE2EDuration="23.079970342s" totalImagesPullingTime="11.861095034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:04.061979182 +0000 UTC m=+23.846823230" watchObservedRunningTime="2026-07-09 14:32:04.079970342 +0000 UTC m=+23.864814390" Jul 09 14:32:04.107934 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.107891 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kqmb7" podStartSLOduration=3.027210156 podStartE2EDuration="23.107872245s" totalImagesPullingTime="20.080662089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:04.107139747 +0000 UTC m=+23.891983794" watchObservedRunningTime="2026-07-09 14:32:04.107872245 +0000 UTC m=+23.892716292" Jul 09 14:32:04.647663 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.647631 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:32:04.647939 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.647861 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 14:32:04.648149 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.648128 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zdbtf" Jul 09 14:32:04.835969 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.835945 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:04.836095 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.835946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:04.836095 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:04.836073 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:32:04.836208 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.836117 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:04.836294 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:04.836261 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:32:04.836660 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:04.836347 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:32:04.871986 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:04.871960 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 14:32:05.019977 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:05.019882 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" event={"ID":"ee475eee2cc4e4319a99b8043bc5a81e","Type":"ContainerStarted","Data":"66a1fd3cd34339ff06fe093d8285079144e49675452e10440a4bd967b2db65cc"} Jul 09 14:32:05.022032 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:05.021985 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" event={"ID":"4a89dae6-1243-4a06-bb11-568474c70bf1","Type":"ContainerStarted","Data":"387638508c560a54af59e1064d429113084ffcad7c8d5f380fbea8277cd64391"} Jul 09 14:32:05.729899 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:05.729806 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:32:04.871982625Z","UUID":"705e14e8-9201-4712-aabd-62cefc9562e7","Handler":null,"Name":"","Endpoint":""} Jul 09 14:32:05.731542 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:05.731510 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 14:32:05.731649 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:05.731551 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 14:32:06.027898 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:06.027828 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt4vr_4bfdb2d6-4c5e-476a-8d63-43b25e66940a/ovn-acl-logging/0.log" Jul 09 14:32:06.028326 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:06.028304 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerStarted","Data":"6edf3581939fadb7d14d63fd8e47f9f930969818e16e1af641ae4f6b9ad21b17"} Jul 09 14:32:06.835795 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:06.835718 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:06.835956 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:06.835718 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:06.835956 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:06.835830 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:06.835956 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:06.835820 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:32:06.835956 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:06.835915 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:32:06.836173 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:06.835988 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:32:07.032992 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:07.032961 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" event={"ID":"4a89dae6-1243-4a06-bb11-568474c70bf1","Type":"ContainerStarted","Data":"8ce09a9a4f3c84a092682ffa7fe93e42af2ef8524aa8007a2dfffcfe47a49dea"} Jul 09 14:32:07.055647 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:07.055605 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwt7s" podStartSLOduration=10.155899641 podStartE2EDuration="25.05558756s" totalImagesPullingTime="14.899687919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:07.055129281 +0000 UTC m=+26.839973340" watchObservedRunningTime="2026-07-09 14:32:07.05558756 +0000 UTC m=+26.840431606" Jul 09 14:32:07.055841 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:07.055783 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-123.ec2.internal" podStartSLOduration=25.055777461 podStartE2EDuration="25.055777461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:05.037994931 +0000 UTC m=+24.822838978" watchObservedRunningTime="2026-07-09 14:32:07.055777461 +0000 UTC m=+26.840621508" Jul 09 14:32:08.835797 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:08.835765 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:08.836162 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:08.835770 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:08.836162 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:08.835902 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:08.836162 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:08.835894 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:32:08.836162 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:08.835960 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:32:08.836162 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:08.836014 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:32:09.042421 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:09.042119 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt4vr_4bfdb2d6-4c5e-476a-8d63-43b25e66940a/ovn-acl-logging/0.log" Jul 09 14:32:09.043048 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:09.042697 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerStarted","Data":"727c92adfec81e6d5ac23ee59c3cd964acd1ebc8d9ccfce16e178c64e11670f5"} Jul 09 14:32:09.043048 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:09.042956 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:32:09.043702 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:09.043167 2565 scope.go:117] "RemoveContainer" containerID="173a9e31cfd39a92b2535a41c936e629155ee914a73b26f931d790300bd23e9f" Jul 09 14:32:09.058546 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:09.058367 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:32:10.048174 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.048151 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt4vr_4bfdb2d6-4c5e-476a-8d63-43b25e66940a/ovn-acl-logging/0.log" Jul 09 14:32:10.049725 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.049692 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" event={"ID":"4bfdb2d6-4c5e-476a-8d63-43b25e66940a","Type":"ContainerStarted","Data":"e66740f2326d8e2f197c01c414c1700a1389c6bc769b07bc2292b15e2523e18d"} Jul 09 14:32:10.050635 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.050411 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:32:10.050635 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.050547 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:32:10.053045 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.053022 2565 generic.go:356] "Generic (PLEG): container finished" podID="12055efe-4e0c-4d22-9dfb-4bea12beaa7c" containerID="dd01473899ac00d2b62d7df002f0adeeaf53a5f23c346489207015ced6876411" exitCode=0 Jul 09 14:32:10.053154 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.053055 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerDied","Data":"dd01473899ac00d2b62d7df002f0adeeaf53a5f23c346489207015ced6876411"} Jul 09 14:32:10.067047 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.067026 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:32:10.090435 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.090401 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" podStartSLOduration=8.969000518 podStartE2EDuration="29.090389577s" totalImagesPullingTime="20.121389059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:10.088569471 +0000 UTC m=+29.873413514" watchObservedRunningTime="2026-07-09 14:32:10.090389577 +0000 UTC m=+29.875233669" Jul 09 14:32:10.836121 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.836092 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:10.836273 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:10.836189 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:32:10.836273 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.836198 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:10.836273 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:10.836237 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:10.836370 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:10.836316 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:32:10.836408 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:10.836380 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:32:11.225989 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:11.225923 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pc8dz"] Jul 09 14:32:11.226354 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:11.226058 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:11.226354 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:11.226139 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:32:11.229009 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:11.228983 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78fcz"] Jul 09 14:32:11.229149 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:11.229078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:11.229217 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:11.229162 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:32:11.229608 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:11.229584 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5979f"] Jul 09 14:32:11.229763 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:11.229714 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:11.229845 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:11.229827 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:32:12.059599 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:12.059568 2565 generic.go:356] "Generic (PLEG): container finished" podID="12055efe-4e0c-4d22-9dfb-4bea12beaa7c" containerID="1097c180d1e579eb89920b69e8cbf47132ed28d044735d984df3747c02e5b0f0" exitCode=0 Jul 09 14:32:12.059751 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:12.059640 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerDied","Data":"1097c180d1e579eb89920b69e8cbf47132ed28d044735d984df3747c02e5b0f0"} Jul 09 14:32:12.835623 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:12.835419 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:12.836075 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:12.835419 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:12.836075 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:12.835428 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:12.836075 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:12.835672 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:32:12.836075 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:12.835743 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:32:12.836075 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:12.835808 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:32:13.064585 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:13.064562 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerStarted","Data":"af7863c670f036d37db19e6a487eff03d285772975a2e247fba5d1eb1a0cba65"} Jul 09 14:32:14.068699 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:14.068647 2565 generic.go:356] "Generic (PLEG): container finished" podID="12055efe-4e0c-4d22-9dfb-4bea12beaa7c" containerID="af7863c670f036d37db19e6a487eff03d285772975a2e247fba5d1eb1a0cba65" exitCode=0 Jul 09 14:32:14.069127 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:14.068713 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerDied","Data":"af7863c670f036d37db19e6a487eff03d285772975a2e247fba5d1eb1a0cba65"} Jul 09 14:32:14.500540 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:14.500502 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:14.500709 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:14.500561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:14.500709 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:14.500619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:14.500709 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.500669 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:32:14.500709 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.500703 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:32:14.500871 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.500716 2565 projected.go:196] Error preparing data for projected volume kube-api-access-qgmqs for pod openshift-network-diagnostics/network-check-target-78fcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:14.500871 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.500742 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:14.500871 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.500773 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:14.500871 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.500775 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs podName:e7eacb00-a29f-45fb-af2c-d3dbdf94db09 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:46.500758159 +0000 UTC m=+66.285602200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qgmqs" (UniqueName: "kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs") pod "network-check-target-78fcz" (UID: "e7eacb00-a29f-45fb-af2c-d3dbdf94db09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:14.500871 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.500819 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret podName:a84b571e-13fd-4648-b24c-8e23722e4f7a nodeName:}" failed. No retries permitted until 2026-07-09 14:32:46.500808045 +0000 UTC m=+66.285652083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret") pod "global-pull-secret-syncer-pc8dz" (UID: "a84b571e-13fd-4648-b24c-8e23722e4f7a") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:14.500871 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.500834 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs podName:b7e3791a-647d-4eba-a8e7-820a07879e4e nodeName:}" failed. No retries permitted until 2026-07-09 14:32:46.500824512 +0000 UTC m=+66.285668550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs") pod "network-metrics-daemon-5979f" (UID: "b7e3791a-647d-4eba-a8e7-820a07879e4e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:14.835616 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:14.835536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:14.835616 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:14.835559 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:14.835818 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:14.835536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:14.835818 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.835647 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pc8dz" podUID="a84b571e-13fd-4648-b24c-8e23722e4f7a" Jul 09 14:32:14.835818 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.835717 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78fcz" podUID="e7eacb00-a29f-45fb-af2c-d3dbdf94db09" Jul 09 14:32:14.835925 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:14.835815 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5979f" podUID="b7e3791a-647d-4eba-a8e7-820a07879e4e" Jul 09 14:32:15.937063 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.936985 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-123.ec2.internal" event="NodeReady" Jul 09 14:32:15.937614 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.937135 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 14:32:15.974725 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.974698 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cdbbf6f54-7sgbl"] Jul 09 14:32:15.978061 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.978046 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:15.981547 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.981525 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:32:15.981866 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.981852 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:32:15.982593 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.982572 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:32:15.982811 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.982799 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcbfq\"" Jul 09 14:32:15.990252 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.990224 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-krz99"] Jul 09 14:32:15.990512 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.990492 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:32:15.993851 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.993835 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-krz99" Jul 09 14:32:15.997095 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.997079 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 14:32:15.997295 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.997281 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 14:32:15.997367 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.997311 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k2mrc\"" Jul 09 14:32:15.997557 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.997539 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 14:32:15.999699 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:15.999603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cdbbf6f54-7sgbl"] Jul 09 14:32:16.000249 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.000229 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mhlm6"] Jul 09 14:32:16.003392 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.003373 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.006428 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.006411 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 14:32:16.006521 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.006479 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkg97\"" Jul 09 14:32:16.006521 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.006484 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 14:32:16.015579 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.015560 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-krz99"] Jul 09 14:32:16.020984 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.020962 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mhlm6"] Jul 09 14:32:16.113878 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.113840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-ca-trust-extracted\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.113878 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.113876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njmwt\" (UniqueName: \"kubernetes.io/projected/0eb4db29-d9e0-4969-ad60-40ace741704a-kube-api-access-njmwt\") pod \"ingress-canary-krz99\" (UID: \"0eb4db29-d9e0-4969-ad60-40ace741704a\") " pod="openshift-ingress-canary/ingress-canary-krz99" Jul 09 14:32:16.114084 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.113894 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.114084 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.113914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9vq\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-kube-api-access-rh9vq\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.114084 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.113940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab174e9-6ddb-47cf-9352-c06fa436fa05-tmp-dir\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.114084 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.113989 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-certificates\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.114084 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.114016 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eb4db29-d9e0-4969-ad60-40ace741704a-cert\") pod \"ingress-canary-krz99\" (UID: \"0eb4db29-d9e0-4969-ad60-40ace741704a\") " pod="openshift-ingress-canary/ingress-canary-krz99" Jul 09 14:32:16.114084 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.114036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-bound-sa-token\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.114084 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.114078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-image-registry-private-configuration\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.114283 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.114104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.114283 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.114128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-trusted-ca\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.114283 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.114158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dtvj\" (UniqueName: \"kubernetes.io/projected/aab174e9-6ddb-47cf-9352-c06fa436fa05-kube-api-access-5dtvj\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.114283 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.114177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-installation-pull-secrets\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.114283 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.114202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aab174e9-6ddb-47cf-9352-c06fa436fa05-config-volume\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.215406 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215306 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-certificates\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.215406 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eb4db29-d9e0-4969-ad60-40ace741704a-cert\") pod \"ingress-canary-krz99\" (UID: \"0eb4db29-d9e0-4969-ad60-40ace741704a\") " pod="openshift-ingress-canary/ingress-canary-krz99" Jul 09 14:32:16.215406 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-bound-sa-token\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.215670 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-image-registry-private-configuration\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.215670 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.215670 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-trusted-ca\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.215670 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dtvj\" (UniqueName: \"kubernetes.io/projected/aab174e9-6ddb-47cf-9352-c06fa436fa05-kube-api-access-5dtvj\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.215670 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-installation-pull-secrets\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.215670 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aab174e9-6ddb-47cf-9352-c06fa436fa05-config-volume\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.215670 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-ca-trust-extracted\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.215670 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njmwt\" (UniqueName: \"kubernetes.io/projected/0eb4db29-d9e0-4969-ad60-40ace741704a-kube-api-access-njmwt\") pod \"ingress-canary-krz99\" (UID: \"0eb4db29-d9e0-4969-ad60-40ace741704a\") " pod="openshift-ingress-canary/ingress-canary-krz99" Jul 09 14:32:16.216065 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.216065 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9vq\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-kube-api-access-rh9vq\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.216065 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.215747 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab174e9-6ddb-47cf-9352-c06fa436fa05-tmp-dir\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.216065 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.216058 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-certificates\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.216265 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.216076 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:16.216265 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.216111 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab174e9-6ddb-47cf-9352-c06fa436fa05-tmp-dir\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.216265 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.216155 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls podName:aab174e9-6ddb-47cf-9352-c06fa436fa05 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:16.716134449 +0000 UTC m=+36.500978490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls") pod "dns-default-mhlm6" (UID: "aab174e9-6ddb-47cf-9352-c06fa436fa05") : secret "dns-default-metrics-tls" not found Jul 09 14:32:16.216425 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.216350 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:32:16.216425 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.216364 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbf6f54-7sgbl: secret "image-registry-tls" not found Jul 09 14:32:16.216425 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.216390 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-ca-trust-extracted\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.216425 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.216407 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls podName:9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a nodeName:}" failed. No retries permitted until 2026-07-09 14:32:16.716393926 +0000 UTC m=+36.501237954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls") pod "image-registry-6cdbbf6f54-7sgbl" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a") : secret "image-registry-tls" not found Jul 09 14:32:16.216914 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.216874 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-trusted-ca\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.217329 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.217287 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aab174e9-6ddb-47cf-9352-c06fa436fa05-config-volume\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.220325 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.220300 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-image-registry-private-configuration\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.220436 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.220304 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-installation-pull-secrets\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.220436 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.220310 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eb4db29-d9e0-4969-ad60-40ace741704a-cert\") pod \"ingress-canary-krz99\" (UID: \"0eb4db29-d9e0-4969-ad60-40ace741704a\") " pod="openshift-ingress-canary/ingress-canary-krz99" Jul 09 14:32:16.229475 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.229452 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dtvj\" (UniqueName: \"kubernetes.io/projected/aab174e9-6ddb-47cf-9352-c06fa436fa05-kube-api-access-5dtvj\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.231370 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.231348 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njmwt\" (UniqueName: \"kubernetes.io/projected/0eb4db29-d9e0-4969-ad60-40ace741704a-kube-api-access-njmwt\") pod \"ingress-canary-krz99\" (UID: \"0eb4db29-d9e0-4969-ad60-40ace741704a\") " pod="openshift-ingress-canary/ingress-canary-krz99" Jul 09 14:32:16.231713 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.231654 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-bound-sa-token\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.232216 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.232190 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9vq\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-kube-api-access-rh9vq\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.302032 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.302011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-krz99" Jul 09 14:32:16.437633 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.437420 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-krz99"] Jul 09 14:32:16.441299 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:32:16.441270 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb4db29_d9e0_4969_ad60_40ace741704a.slice/crio-4903b6d1e134a24ca6d3d20a64b323938bd6c9e3088f8da2716527e93c7dcb2b WatchSource:0}: Error finding container 4903b6d1e134a24ca6d3d20a64b323938bd6c9e3088f8da2716527e93c7dcb2b: Status 404 returned error can't find the container with id 4903b6d1e134a24ca6d3d20a64b323938bd6c9e3088f8da2716527e93c7dcb2b Jul 09 14:32:16.719808 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.719771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:16.719986 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.719885 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:16.719986 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.719920 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:16.720100 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.720010 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls podName:aab174e9-6ddb-47cf-9352-c06fa436fa05 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:17.719988289 +0000 UTC m=+37.504832328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls") pod "dns-default-mhlm6" (UID: "aab174e9-6ddb-47cf-9352-c06fa436fa05") : secret "dns-default-metrics-tls" not found Jul 09 14:32:16.720100 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.720011 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:32:16.720100 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.720027 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbf6f54-7sgbl: secret "image-registry-tls" not found Jul 09 14:32:16.720100 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:16.720053 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls podName:9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a nodeName:}" failed. No retries permitted until 2026-07-09 14:32:17.720044344 +0000 UTC m=+37.504888368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls") pod "image-registry-6cdbbf6f54-7sgbl" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a") : secret "image-registry-tls" not found Jul 09 14:32:16.835938 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.835907 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:16.835938 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.835923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:16.836163 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.836077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:16.842258 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.842126 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:32:16.842258 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.842140 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-txwkz\"" Jul 09 14:32:16.842258 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.842163 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:32:16.842258 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.842130 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:32:16.842517 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.842497 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:32:16.842760 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:16.842744 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l2qn4\"" Jul 09 14:32:17.077728 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:17.077627 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-krz99" event={"ID":"0eb4db29-d9e0-4969-ad60-40ace741704a","Type":"ContainerStarted","Data":"4903b6d1e134a24ca6d3d20a64b323938bd6c9e3088f8da2716527e93c7dcb2b"} Jul 09 14:32:17.728369 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:17.728333 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:17.728514 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:17.728430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:17.728514 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:17.728499 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:17.728614 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:17.728520 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:32:17.728614 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:17.728532 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbf6f54-7sgbl: secret "image-registry-tls" not found Jul 09 14:32:17.728614 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:17.728572 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls podName:9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a nodeName:}" failed. No retries permitted until 2026-07-09 14:32:19.728553335 +0000 UTC m=+39.513397373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls") pod "image-registry-6cdbbf6f54-7sgbl" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a") : secret "image-registry-tls" not found Jul 09 14:32:17.728614 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:17.728588 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls podName:aab174e9-6ddb-47cf-9352-c06fa436fa05 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:19.728579352 +0000 UTC m=+39.513423376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls") pod "dns-default-mhlm6" (UID: "aab174e9-6ddb-47cf-9352-c06fa436fa05") : secret "dns-default-metrics-tls" not found Jul 09 14:32:19.746603 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:19.746519 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:19.747055 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:19.746697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:19.747055 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:19.746714 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:19.747055 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:19.746793 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls podName:aab174e9-6ddb-47cf-9352-c06fa436fa05 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:23.746772797 +0000 UTC m=+43.531616839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls") pod "dns-default-mhlm6" (UID: "aab174e9-6ddb-47cf-9352-c06fa436fa05") : secret "dns-default-metrics-tls" not found Jul 09 14:32:19.747055 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:19.746794 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:32:19.747055 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:19.746807 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbf6f54-7sgbl: secret "image-registry-tls" not found Jul 09 14:32:19.747055 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:19.746854 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls podName:9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a nodeName:}" failed. No retries permitted until 2026-07-09 14:32:23.746842159 +0000 UTC m=+43.531686199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls") pod "image-registry-6cdbbf6f54-7sgbl" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a") : secret "image-registry-tls" not found Jul 09 14:32:20.086899 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:20.086815 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-krz99" event={"ID":"0eb4db29-d9e0-4969-ad60-40ace741704a","Type":"ContainerStarted","Data":"1d9edda67f415931f70382992f649d4ba1f4e833ab2a60a54641854135d13174"} Jul 09 14:32:20.105586 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:20.105538 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-krz99" podStartSLOduration=2.088082215 podStartE2EDuration="5.105511765s" totalImagesPullingTime="3.01742955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:20.104882227 +0000 UTC m=+39.889726274" watchObservedRunningTime="2026-07-09 14:32:20.105511765 +0000 UTC m=+39.890355848" Jul 09 14:32:22.093344 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:22.093117 2565 generic.go:356] "Generic (PLEG): container finished" podID="12055efe-4e0c-4d22-9dfb-4bea12beaa7c" containerID="cf917cc8e0bcbd43c357d313bd385a13fd26dd9addf5d7fd8a20e7b936d3c0d8" exitCode=0 Jul 09 14:32:22.093344 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:22.093186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerDied","Data":"cf917cc8e0bcbd43c357d313bd385a13fd26dd9addf5d7fd8a20e7b936d3c0d8"} Jul 09 14:32:23.098857 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:23.098795 2565 generic.go:356] "Generic (PLEG): container finished" podID="12055efe-4e0c-4d22-9dfb-4bea12beaa7c" containerID="cc020235d4e7fdb04a6d5d41ceeb75f10fdf8563192d8bde711f0c828927eb8e" exitCode=0 Jul 09 14:32:23.098857 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:23.098860 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerDied","Data":"cc020235d4e7fdb04a6d5d41ceeb75f10fdf8563192d8bde711f0c828927eb8e"} Jul 09 14:32:23.776307 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:23.776268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:23.776453 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:23.776341 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:23.776453 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:23.776408 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:23.776453 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:23.776426 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:32:23.776453 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:23.776436 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbf6f54-7sgbl: secret "image-registry-tls" not found Jul 09 14:32:23.776598 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:23.776469 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls podName:aab174e9-6ddb-47cf-9352-c06fa436fa05 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:31.776453192 +0000 UTC m=+51.561297220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls") pod "dns-default-mhlm6" (UID: "aab174e9-6ddb-47cf-9352-c06fa436fa05") : secret "dns-default-metrics-tls" not found Jul 09 14:32:23.776598 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:23.776482 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls podName:9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a nodeName:}" failed. No retries permitted until 2026-07-09 14:32:31.776476153 +0000 UTC m=+51.561320178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls") pod "image-registry-6cdbbf6f54-7sgbl" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a") : secret "image-registry-tls" not found Jul 09 14:32:24.104400 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:24.104325 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x6727" event={"ID":"12055efe-4e0c-4d22-9dfb-4bea12beaa7c","Type":"ContainerStarted","Data":"c230447f84c8281d7d86d08362146a10870d752825099581cddb166ba45cbb5f"} Jul 09 14:32:24.133742 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:24.133696 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x6727" podStartSLOduration=12.352467949 podStartE2EDuration="43.133666703s" totalImagesPullingTime="30.781198754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:24.131515852 +0000 UTC m=+43.916359900" watchObservedRunningTime="2026-07-09 14:32:24.133666703 +0000 UTC m=+43.918510777" Jul 09 14:32:31.830752 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:31.830710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:31.831261 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:31.830775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:31.831261 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:31.830870 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:32:31.831261 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:31.830893 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbf6f54-7sgbl: secret "image-registry-tls" not found Jul 09 14:32:31.831261 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:31.830896 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:31.831261 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:31.830944 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls podName:aab174e9-6ddb-47cf-9352-c06fa436fa05 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:47.830931672 +0000 UTC m=+67.615775697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls") pod "dns-default-mhlm6" (UID: "aab174e9-6ddb-47cf-9352-c06fa436fa05") : secret "dns-default-metrics-tls" not found Jul 09 14:32:31.831261 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:31.830957 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls podName:9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a nodeName:}" failed. No retries permitted until 2026-07-09 14:32:47.830951028 +0000 UTC m=+67.615795053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls") pod "image-registry-6cdbbf6f54-7sgbl" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a") : secret "image-registry-tls" not found Jul 09 14:32:42.077815 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:42.077788 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zt4vr" Jul 09 14:32:46.528761 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.528710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:32:46.529203 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.528796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:46.529203 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.528817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:46.532186 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.532164 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:32:46.532266 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.532223 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:32:46.532328 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.532227 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:32:46.539110 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:46.539089 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:32:46.539228 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:46.539152 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs podName:b7e3791a-647d-4eba-a8e7-820a07879e4e nodeName:}" failed. No retries permitted until 2026-07-09 14:33:50.539134335 +0000 UTC m=+130.323978360 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs") pod "network-metrics-daemon-5979f" (UID: "b7e3791a-647d-4eba-a8e7-820a07879e4e") : secret "metrics-daemon-secret" not found Jul 09 14:32:46.542340 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.542316 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:32:46.542782 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.542763 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a84b571e-13fd-4648-b24c-8e23722e4f7a-original-pull-secret\") pod \"global-pull-secret-syncer-pc8dz\" (UID: \"a84b571e-13fd-4648-b24c-8e23722e4f7a\") " pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:46.552288 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.552266 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgmqs\" (UniqueName: \"kubernetes.io/projected/e7eacb00-a29f-45fb-af2c-d3dbdf94db09-kube-api-access-qgmqs\") pod \"network-check-target-78fcz\" (UID: \"e7eacb00-a29f-45fb-af2c-d3dbdf94db09\") " pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:46.557059 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.557040 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pc8dz" Jul 09 14:32:46.675130 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.675099 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pc8dz"] Jul 09 14:32:46.678025 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:32:46.677996 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84b571e_13fd_4648_b24c_8e23722e4f7a.slice/crio-c8c79626879cc18b4999643254533bdec238bea09bf1c9fe5c755755ef82171d WatchSource:0}: Error finding container c8c79626879cc18b4999643254533bdec238bea09bf1c9fe5c755755ef82171d: Status 404 returned error can't find the container with id c8c79626879cc18b4999643254533bdec238bea09bf1c9fe5c755755ef82171d Jul 09 14:32:46.852475 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.852398 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l2qn4\"" Jul 09 14:32:46.860072 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.860052 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:46.977346 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:46.977312 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78fcz"] Jul 09 14:32:46.979912 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:32:46.979887 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7eacb00_a29f_45fb_af2c_d3dbdf94db09.slice/crio-2999da16cd8e17d206a34b4a26e08c64fa17126224b08a4cbc882b37193fff62 WatchSource:0}: Error finding container 2999da16cd8e17d206a34b4a26e08c64fa17126224b08a4cbc882b37193fff62: Status 404 returned error can't find the container with id 2999da16cd8e17d206a34b4a26e08c64fa17126224b08a4cbc882b37193fff62 Jul 09 14:32:47.157369 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:47.157280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pc8dz" event={"ID":"a84b571e-13fd-4648-b24c-8e23722e4f7a","Type":"ContainerStarted","Data":"c8c79626879cc18b4999643254533bdec238bea09bf1c9fe5c755755ef82171d"} Jul 09 14:32:47.158318 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:47.158295 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78fcz" event={"ID":"e7eacb00-a29f-45fb-af2c-d3dbdf94db09","Type":"ContainerStarted","Data":"2999da16cd8e17d206a34b4a26e08c64fa17126224b08a4cbc882b37193fff62"} Jul 09 14:32:47.838573 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:47.838534 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:32:47.839044 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:47.838606 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:32:47.839044 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:47.838756 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:47.839044 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:47.838806 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:32:47.839044 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:47.838829 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cdbbf6f54-7sgbl: secret "image-registry-tls" not found Jul 09 14:32:47.839044 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:47.838817 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls podName:aab174e9-6ddb-47cf-9352-c06fa436fa05 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:19.838797435 +0000 UTC m=+99.623641480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls") pod "dns-default-mhlm6" (UID: "aab174e9-6ddb-47cf-9352-c06fa436fa05") : secret "dns-default-metrics-tls" not found Jul 09 14:32:47.839044 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:47.838918 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls podName:9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a nodeName:}" failed. No retries permitted until 2026-07-09 14:33:19.838899127 +0000 UTC m=+99.623743156 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls") pod "image-registry-6cdbbf6f54-7sgbl" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a") : secret "image-registry-tls" not found Jul 09 14:32:51.169775 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:51.169736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78fcz" event={"ID":"e7eacb00-a29f-45fb-af2c-d3dbdf94db09","Type":"ContainerStarted","Data":"95c731ff81d74c310eafde6ea4494c758810f069d2ed003ec1fd91f31cdc4399"} Jul 09 14:32:51.170220 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:51.169865 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:32:51.189013 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:51.188960 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-78fcz" podStartSLOduration=66.157332478 podStartE2EDuration="1m10.188938843s" totalImagesPullingTime="4.031606365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:51.188093598 +0000 UTC m=+70.972937646" watchObservedRunningTime="2026-07-09 14:32:51.188938843 +0000 UTC m=+70.973782890" Jul 09 14:32:53.175387 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:53.175349 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pc8dz" event={"ID":"a84b571e-13fd-4648-b24c-8e23722e4f7a","Type":"ContainerStarted","Data":"d241809e2ef9c46e211da6d22e1a05d2bf943ec90e8c14ab9bc0d0297a248a4c"} Jul 09 14:32:53.193358 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:53.193308 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pc8dz" podStartSLOduration=65.362104112 podStartE2EDuration="1m11.193292632s" totalImagesPullingTime="5.83118852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:53.192511023 +0000 UTC m=+72.977355069" watchObservedRunningTime="2026-07-09 14:32:53.193292632 +0000 UTC m=+72.978136709" Jul 09 14:32:58.431274 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.431240 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-976764b8d-88jrj"] Jul 09 14:32:58.433853 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.433832 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.437593 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.437550 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 14:32:58.437730 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.437604 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:32:58.437877 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.437855 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 14:32:58.437877 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.437860 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 14:32:58.438005 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.437992 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 14:32:58.438166 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.438149 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fltfb\"" Jul 09 14:32:58.439135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.439121 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:32:58.450774 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.450752 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-976764b8d-88jrj"] Jul 09 14:32:58.518461 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.518439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.518573 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.518475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p8h9\" (UniqueName: \"kubernetes.io/projected/d9f81b25-bc4a-4510-b7a3-dda245a8180d-kube-api-access-7p8h9\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.518573 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.518498 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-default-certificate\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.518573 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.518521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-stats-auth\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.518668 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.518569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.619050 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.619010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p8h9\" (UniqueName: \"kubernetes.io/projected/d9f81b25-bc4a-4510-b7a3-dda245a8180d-kube-api-access-7p8h9\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.619050 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.619054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-default-certificate\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.619257 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.619083 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-stats-auth\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.619345 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.619322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.619449 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.619431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.619489 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:58.619441 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:32:58.619537 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:58.619529 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:32:59.119509875 +0000 UTC m=+78.904353901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : secret "router-metrics-certs-default" not found Jul 09 14:32:58.619585 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:58.619560 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:32:59.119552195 +0000 UTC m=+78.904396237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : configmap references non-existent config key: service-ca.crt Jul 09 14:32:58.621645 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.621617 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-default-certificate\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.621738 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.621661 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-stats-auth\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:58.630923 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:58.630900 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p8h9\" (UniqueName: \"kubernetes.io/projected/d9f81b25-bc4a-4510-b7a3-dda245a8180d-kube-api-access-7p8h9\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:59.122304 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:59.122268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:59.122485 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:32:59.122361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:32:59.122485 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:59.122410 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:32:59.122485 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:59.122473 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:00.122459125 +0000 UTC m=+79.907303150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : secret "router-metrics-certs-default" not found Jul 09 14:32:59.122606 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:32:59.122488 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:00.122481729 +0000 UTC m=+79.907325754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : configmap references non-existent config key: service-ca.crt Jul 09 14:33:00.129503 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:00.129461 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:00.129976 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:00.129545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:00.129976 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:00.129640 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:02.129617862 +0000 UTC m=+81.914461891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : configmap references non-existent config key: service-ca.crt Jul 09 14:33:00.129976 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:00.129697 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:33:00.129976 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:00.129754 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:02.129737726 +0000 UTC m=+81.914581763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : secret "router-metrics-certs-default" not found Jul 09 14:33:02.144106 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:02.144054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:02.144106 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:02.144124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:02.144536 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:02.144218 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:33:02.144536 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:02.144238 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:06.144220955 +0000 UTC m=+85.929064980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : configmap references non-existent config key: service-ca.crt Jul 09 14:33:02.144536 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:02.144271 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:06.144258336 +0000 UTC m=+85.929102364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : secret "router-metrics-certs-default" not found Jul 09 14:33:04.860750 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.860603 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qdf8n"] Jul 09 14:33:04.865059 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.865036 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:04.868183 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.868163 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 14:33:04.868478 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.868454 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 14:33:04.868567 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.868467 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 14:33:04.869920 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.869904 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 14:33:04.869975 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.869960 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qwk62\"" Jul 09 14:33:04.881240 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.881219 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qdf8n"] Jul 09 14:33:04.962593 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.962560 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwlbx\" (UniqueName: \"kubernetes.io/projected/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-api-access-cwlbx\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:04.962792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.962602 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-data-volume\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:04.962792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.962628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:04.962792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.962722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-crio-socket\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:04.962792 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:04.962781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.063741 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.063711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwlbx\" (UniqueName: \"kubernetes.io/projected/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-api-access-cwlbx\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.063827 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.063762 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-data-volume\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.063827 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.063783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.063827 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.063803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-crio-socket\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.063963 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.063840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.063963 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:05.063909 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:05.063963 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:05.063919 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:05.063963 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:05.063955 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:05.563942987 +0000 UTC m=+85.348787011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : configmap "kube-rbac-proxy" not found Jul 09 14:33:05.064160 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:05.063986 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:05.5639705 +0000 UTC m=+85.348814524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:05.064160 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.063918 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-crio-socket\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.064296 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.064278 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-data-volume\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.076147 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.076121 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwlbx\" (UniqueName: \"kubernetes.io/projected/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-api-access-cwlbx\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.567660 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.567616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.567878 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.567694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:05.567878 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:05.567771 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:05.567878 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:05.567785 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:05.567878 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:05.567838 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:06.56782148 +0000 UTC m=+86.352665513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : configmap "kube-rbac-proxy" not found Jul 09 14:33:05.567878 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:05.567853 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:06.567846966 +0000 UTC m=+86.352690991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:05.711317 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.711285 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-fpvvv"] Jul 09 14:33:05.714355 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.714340 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:05.717466 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.717449 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 14:33:05.718967 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.718954 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 14:33:05.719026 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.718994 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 14:33:05.719114 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.719100 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 14:33:05.719175 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.719104 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gpkzq\"" Jul 09 14:33:05.724771 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.724753 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-fpvvv"] Jul 09 14:33:05.769575 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.769551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl4xh\" (UniqueName: \"kubernetes.io/projected/651876c1-5448-47b5-9dec-d0afb1d16abb-kube-api-access-hl4xh\") pod \"service-ca-79f68b9f4f-fpvvv\" (UID: \"651876c1-5448-47b5-9dec-d0afb1d16abb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:05.769719 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.769698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/651876c1-5448-47b5-9dec-d0afb1d16abb-signing-key\") pod \"service-ca-79f68b9f4f-fpvvv\" (UID: \"651876c1-5448-47b5-9dec-d0afb1d16abb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:05.769766 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.769741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/651876c1-5448-47b5-9dec-d0afb1d16abb-signing-cabundle\") pod \"service-ca-79f68b9f4f-fpvvv\" (UID: \"651876c1-5448-47b5-9dec-d0afb1d16abb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:05.870428 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.870359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/651876c1-5448-47b5-9dec-d0afb1d16abb-signing-key\") pod \"service-ca-79f68b9f4f-fpvvv\" (UID: \"651876c1-5448-47b5-9dec-d0afb1d16abb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:05.870428 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.870400 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/651876c1-5448-47b5-9dec-d0afb1d16abb-signing-cabundle\") pod \"service-ca-79f68b9f4f-fpvvv\" (UID: \"651876c1-5448-47b5-9dec-d0afb1d16abb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:05.870885 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.870431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl4xh\" (UniqueName: \"kubernetes.io/projected/651876c1-5448-47b5-9dec-d0afb1d16abb-kube-api-access-hl4xh\") pod \"service-ca-79f68b9f4f-fpvvv\" (UID: \"651876c1-5448-47b5-9dec-d0afb1d16abb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:05.870996 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.870977 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/651876c1-5448-47b5-9dec-d0afb1d16abb-signing-cabundle\") pod \"service-ca-79f68b9f4f-fpvvv\" (UID: \"651876c1-5448-47b5-9dec-d0afb1d16abb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:05.873490 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.873466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/651876c1-5448-47b5-9dec-d0afb1d16abb-signing-key\") pod \"service-ca-79f68b9f4f-fpvvv\" (UID: \"651876c1-5448-47b5-9dec-d0afb1d16abb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:05.880748 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:05.880724 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl4xh\" (UniqueName: \"kubernetes.io/projected/651876c1-5448-47b5-9dec-d0afb1d16abb-kube-api-access-hl4xh\") pod \"service-ca-79f68b9f4f-fpvvv\" (UID: \"651876c1-5448-47b5-9dec-d0afb1d16abb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:06.022984 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:06.022944 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" Jul 09 14:33:06.141916 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:06.141854 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-fpvvv"] Jul 09 14:33:06.144546 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:33:06.144510 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651876c1_5448_47b5_9dec_d0afb1d16abb.slice/crio-95ae8bec1879ee0c5d2ad546eabe3094424679df13cbedbe6c898e0de4fa8d25 WatchSource:0}: Error finding container 95ae8bec1879ee0c5d2ad546eabe3094424679df13cbedbe6c898e0de4fa8d25: Status 404 returned error can't find the container with id 95ae8bec1879ee0c5d2ad546eabe3094424679df13cbedbe6c898e0de4fa8d25 Jul 09 14:33:06.172859 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:06.172833 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:06.172943 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:06.172880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:06.172988 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:06.172965 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:33:06.173021 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:06.173016 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:14.173001728 +0000 UTC m=+93.957845753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : secret "router-metrics-certs-default" not found Jul 09 14:33:06.173067 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:06.173030 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:14.173024191 +0000 UTC m=+93.957868215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : configmap references non-existent config key: service-ca.crt Jul 09 14:33:06.207551 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:06.207526 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" event={"ID":"651876c1-5448-47b5-9dec-d0afb1d16abb","Type":"ContainerStarted","Data":"95ae8bec1879ee0c5d2ad546eabe3094424679df13cbedbe6c898e0de4fa8d25"} Jul 09 14:33:06.576311 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:06.576279 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:06.576498 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:06.576328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:06.576498 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:06.576407 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:06.576498 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:06.576421 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:06.576498 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:06.576470 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:08.576457448 +0000 UTC m=+88.361301472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:06.576498 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:06.576483 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:08.576477351 +0000 UTC m=+88.361321389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : configmap "kube-rbac-proxy" not found Jul 09 14:33:07.860514 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:07.860489 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znhx8_dd56578a-50aa-4c05-98eb-f918768d2392/dns-node-resolver/0.log" Jul 09 14:33:08.460058 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:08.460032 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dmlkq_890717d4-da1d-4362-a06d-ee3c6bf0197d/node-ca/0.log" Jul 09 14:33:08.590619 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:08.590582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:08.590749 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:08.590716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:08.590749 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:08.590728 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:08.590882 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:08.590793 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:12.590772831 +0000 UTC m=+92.375616872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : configmap "kube-rbac-proxy" not found Jul 09 14:33:08.590882 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:08.590864 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:08.590998 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:08.590941 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:12.590923151 +0000 UTC m=+92.375767190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:09.217009 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:09.216976 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" event={"ID":"651876c1-5448-47b5-9dec-d0afb1d16abb","Type":"ContainerStarted","Data":"7017522bdb26a018379840198ac6a627beaec98948122d202f1e6a41abb61602"} Jul 09 14:33:09.234891 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:09.234844 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-fpvvv" podStartSLOduration=1.8066600940000002 podStartE2EDuration="4.234827408s" totalImagesPullingTime="2.428167314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:09.234167305 +0000 UTC m=+89.019011352" watchObservedRunningTime="2026-07-09 14:33:09.234827408 +0000 UTC m=+89.019671454" Jul 09 14:33:09.459514 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:09.459484 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-krz99_0eb4db29-d9e0-4969-ad60-40ace741704a/serve-healthcheck-canary/0.log" Jul 09 14:33:12.624578 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:12.624544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:12.624962 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:12.624587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:12.624962 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:12.624660 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:12.624962 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:12.624697 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:12.624962 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:12.624734 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:20.624719052 +0000 UTC m=+100.409563081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : configmap "kube-rbac-proxy" not found Jul 09 14:33:12.624962 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:12.624750 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:20.624743409 +0000 UTC m=+100.409587434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:14.240301 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:14.240271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:14.240674 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:14.240330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:14.240674 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:14.240416 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:33:14.240674 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:14.240448 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:30.240435697 +0000 UTC m=+110.025279721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : configmap references non-existent config key: service-ca.crt Jul 09 14:33:14.240674 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:14.240467 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs podName:d9f81b25-bc4a-4510-b7a3-dda245a8180d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:30.240455094 +0000 UTC m=+110.025299119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs") pod "router-default-976764b8d-88jrj" (UID: "d9f81b25-bc4a-4510-b7a3-dda245a8180d") : secret "router-metrics-certs-default" not found Jul 09 14:33:19.885270 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:19.885236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:33:19.885771 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:19.885278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:33:19.887639 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:19.887612 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aab174e9-6ddb-47cf-9352-c06fa436fa05-metrics-tls\") pod \"dns-default-mhlm6\" (UID: \"aab174e9-6ddb-47cf-9352-c06fa436fa05\") " pod="openshift-dns/dns-default-mhlm6" Jul 09 14:33:19.887779 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:19.887761 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"image-registry-6cdbbf6f54-7sgbl\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:33:19.914149 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:19.914121 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkg97\"" Jul 09 14:33:19.921000 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:19.920981 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mhlm6" Jul 09 14:33:20.046112 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:20.046082 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mhlm6"] Jul 09 14:33:20.048651 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:33:20.048626 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab174e9_6ddb_47cf_9352_c06fa436fa05.slice/crio-dc552aa412f913436c5aa69f80c8ad79c947123eee2de0d3b8d8499740a3aa9c WatchSource:0}: Error finding container dc552aa412f913436c5aa69f80c8ad79c947123eee2de0d3b8d8499740a3aa9c: Status 404 returned error can't find the container with id dc552aa412f913436c5aa69f80c8ad79c947123eee2de0d3b8d8499740a3aa9c Jul 09 14:33:20.190922 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:20.190895 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcbfq\"" Jul 09 14:33:20.197733 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:20.197711 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:33:20.246750 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:20.246716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mhlm6" event={"ID":"aab174e9-6ddb-47cf-9352-c06fa436fa05","Type":"ContainerStarted","Data":"dc552aa412f913436c5aa69f80c8ad79c947123eee2de0d3b8d8499740a3aa9c"} Jul 09 14:33:20.325874 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:20.325851 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cdbbf6f54-7sgbl"] Jul 09 14:33:20.327743 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:33:20.327720 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dbf0e0c_2822_4f61_8f98_c6c8c89bab2a.slice/crio-344e47cafe32bd7f113d9627396175c0d0b7b47d1f5f091f52c8cd9370436b3c WatchSource:0}: Error finding container 344e47cafe32bd7f113d9627396175c0d0b7b47d1f5f091f52c8cd9370436b3c: Status 404 returned error can't find the container with id 344e47cafe32bd7f113d9627396175c0d0b7b47d1f5f091f52c8cd9370436b3c Jul 09 14:33:20.691175 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:20.691142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:20.691330 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:20.691194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:20.691330 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:20.691308 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:20.691409 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:20.691376 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls podName:e9a24882-b0bb-46de-93c9-e2b9caa49bd6 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:36.691357437 +0000 UTC m=+116.476201477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qdf8n" (UID: "e9a24882-b0bb-46de-93c9-e2b9caa49bd6") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:20.691789 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:20.691771 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:21.251343 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:21.251297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" event={"ID":"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a","Type":"ContainerStarted","Data":"c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341"} Jul 09 14:33:21.251736 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:21.251352 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" event={"ID":"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a","Type":"ContainerStarted","Data":"344e47cafe32bd7f113d9627396175c0d0b7b47d1f5f091f52c8cd9370436b3c"} Jul 09 14:33:21.251736 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:21.251380 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:33:21.278163 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:21.278114 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" podStartSLOduration=100.278100422 podStartE2EDuration="1m40.278100422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:21.276157006 +0000 UTC m=+101.061001060" watchObservedRunningTime="2026-07-09 14:33:21.278100422 +0000 UTC m=+101.062944469" Jul 09 14:33:22.175660 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:22.175627 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-78fcz" Jul 09 14:33:23.258565 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:23.258526 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mhlm6" event={"ID":"aab174e9-6ddb-47cf-9352-c06fa436fa05","Type":"ContainerStarted","Data":"1e0ec55fc33375e3887950b2510f7aebe23d088444164a411aee216d8c653e12"} Jul 09 14:33:23.258946 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:23.258575 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mhlm6" event={"ID":"aab174e9-6ddb-47cf-9352-c06fa436fa05","Type":"ContainerStarted","Data":"8434a5a96d4cfcf1c842cc2eacea7feed35c281b86076b209fec752ab26a7b6b"} Jul 09 14:33:23.258946 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:23.258656 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mhlm6" Jul 09 14:33:27.762760 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.762702 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mhlm6" podStartSLOduration=70.493860232 podStartE2EDuration="1m12.762669825s" totalImagesPullingTime="2.268809593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:23.279147529 +0000 UTC m=+103.063991577" watchObservedRunningTime="2026-07-09 14:33:27.762669825 +0000 UTC m=+107.547513873" Jul 09 14:33:27.763285 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.763269 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq"] Jul 09 14:33:27.765830 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.765812 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.769726 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.769702 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 14:33:27.769856 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.769699 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 14:33:27.769856 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.769779 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 14:33:27.771030 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.771005 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 14:33:27.771030 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.771022 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 14:33:27.771244 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.771010 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 14:33:27.771533 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.771519 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 14:33:27.783611 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.783590 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq"] Jul 09 14:33:27.849283 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.849252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhk54\" (UniqueName: \"kubernetes.io/projected/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-kube-api-access-zhk54\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.849398 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.849312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.849398 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.849364 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.849479 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.849416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-hub\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.849479 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.849456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.849479 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.849475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-ca\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.950326 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.950290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-hub\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.950482 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.950344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.950482 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.950364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-ca\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.950482 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.950393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhk54\" (UniqueName: \"kubernetes.io/projected/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-kube-api-access-zhk54\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.950482 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.950426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.950482 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.950450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.951301 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.951273 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.952949 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.952922 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.953055 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.953007 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-ca\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.953112 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.953098 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.953168 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.953141 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-hub\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:27.969552 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:27.969528 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhk54\" (UniqueName: \"kubernetes.io/projected/5eb6ac8d-a6a0-4467-891c-a784b5f14f5e-kube-api-access-zhk54\") pod \"cluster-proxy-proxy-agent-74d9bc64f5-27kqq\" (UID: \"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:28.082004 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:28.081927 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" Jul 09 14:33:28.207565 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:28.207535 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq"] Jul 09 14:33:28.210510 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:33:28.210481 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5eb6ac8d_a6a0_4467_891c_a784b5f14f5e.slice/crio-84078b49eeae3850c7608136d2061d457c25f2b5b5f5e0ab5a92b08d06dc0477 WatchSource:0}: Error finding container 84078b49eeae3850c7608136d2061d457c25f2b5b5f5e0ab5a92b08d06dc0477: Status 404 returned error can't find the container with id 84078b49eeae3850c7608136d2061d457c25f2b5b5f5e0ab5a92b08d06dc0477 Jul 09 14:33:28.276714 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:28.276673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" event={"ID":"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e","Type":"ContainerStarted","Data":"84078b49eeae3850c7608136d2061d457c25f2b5b5f5e0ab5a92b08d06dc0477"} Jul 09 14:33:30.269898 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:30.269836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:30.269898 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:30.269900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:30.270618 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:30.270595 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9f81b25-bc4a-4510-b7a3-dda245a8180d-service-ca-bundle\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:30.272796 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:30.272773 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f81b25-bc4a-4510-b7a3-dda245a8180d-metrics-certs\") pod \"router-default-976764b8d-88jrj\" (UID: \"d9f81b25-bc4a-4510-b7a3-dda245a8180d\") " pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:30.542718 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:30.542613 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:30.682467 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:30.682439 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-976764b8d-88jrj"] Jul 09 14:33:31.731198 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:33:31.731164 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f81b25_bc4a_4510_b7a3_dda245a8180d.slice/crio-6a05071bd01269e447896c456be379ed9cd7143ad446146c6d5ad23de01e41f5 WatchSource:0}: Error finding container 6a05071bd01269e447896c456be379ed9cd7143ad446146c6d5ad23de01e41f5: Status 404 returned error can't find the container with id 6a05071bd01269e447896c456be379ed9cd7143ad446146c6d5ad23de01e41f5 Jul 09 14:33:32.292003 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:32.291967 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-976764b8d-88jrj" event={"ID":"d9f81b25-bc4a-4510-b7a3-dda245a8180d","Type":"ContainerStarted","Data":"77581f4df09459fde6935cc3bbee1ac97ade7a3d9a1e776c3c909d8f7815f365"} Jul 09 14:33:32.292168 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:32.292055 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-976764b8d-88jrj" event={"ID":"d9f81b25-bc4a-4510-b7a3-dda245a8180d","Type":"ContainerStarted","Data":"6a05071bd01269e447896c456be379ed9cd7143ad446146c6d5ad23de01e41f5"} Jul 09 14:33:32.294022 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:32.294001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" event={"ID":"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e","Type":"ContainerStarted","Data":"9ae6fc5f077fc34fb2f0a55b9240e501d039ef4a7fcb93df74bb85dbf13ae5a0"} Jul 09 14:33:32.294174 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:32.294046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" event={"ID":"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e","Type":"ContainerStarted","Data":"f119e3bf9bc8f99201492eb629e7a158cfe5df16e86877416293f14c69f8ae27"} Jul 09 14:33:32.294174 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:32.294061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" event={"ID":"5eb6ac8d-a6a0-4467-891c-a784b5f14f5e","Type":"ContainerStarted","Data":"e56bae3367847435d51ce865408f3a43f0183e8a7afc89b4788bdc831a4e68b4"} Jul 09 14:33:32.318107 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:32.318065 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-976764b8d-88jrj" podStartSLOduration=34.318050859 podStartE2EDuration="34.318050859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:32.317613237 +0000 UTC m=+112.102457283" watchObservedRunningTime="2026-07-09 14:33:32.318050859 +0000 UTC m=+112.102894906" Jul 09 14:33:32.343324 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:32.343275 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d9bc64f5-27kqq" podStartSLOduration=1.757618771 podStartE2EDuration="5.343260948s" totalImagesPullingTime="3.585642177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:32.342814275 +0000 UTC m=+112.127658323" watchObservedRunningTime="2026-07-09 14:33:32.343260948 +0000 UTC m=+112.128104995" Jul 09 14:33:32.543884 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:32.543791 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:32.546417 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:32.546394 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:33.265557 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:33.265532 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mhlm6" Jul 09 14:33:33.298141 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:33.298112 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:33.299369 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:33.299344 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-976764b8d-88jrj" Jul 09 14:33:36.724557 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:36.724517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:36.726804 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:36.726782 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9a24882-b0bb-46de-93c9-e2b9caa49bd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qdf8n\" (UID: \"e9a24882-b0bb-46de-93c9-e2b9caa49bd6\") " pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:36.973310 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:36.973274 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qdf8n" Jul 09 14:33:37.095529 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:37.095507 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qdf8n"] Jul 09 14:33:37.097945 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:33:37.097920 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a24882_b0bb_46de_93c9_e2b9caa49bd6.slice/crio-a665992fb66ecc7e72db69006ce2a0aa5da556780ffbeded0c80575a5f3349e2 WatchSource:0}: Error finding container a665992fb66ecc7e72db69006ce2a0aa5da556780ffbeded0c80575a5f3349e2: Status 404 returned error can't find the container with id a665992fb66ecc7e72db69006ce2a0aa5da556780ffbeded0c80575a5f3349e2 Jul 09 14:33:37.312784 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:37.312706 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qdf8n" event={"ID":"e9a24882-b0bb-46de-93c9-e2b9caa49bd6","Type":"ContainerStarted","Data":"a665992fb66ecc7e72db69006ce2a0aa5da556780ffbeded0c80575a5f3349e2"} Jul 09 14:33:40.203236 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:40.203187 2565 patch_prober.go:28] interesting pod/image-registry-6cdbbf6f54-7sgbl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 14:33:40.203631 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:40.203252 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" podUID="9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 14:33:41.327555 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:41.327517 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qdf8n" event={"ID":"e9a24882-b0bb-46de-93c9-e2b9caa49bd6","Type":"ContainerStarted","Data":"4979d37404c7566edc213f00412eb9e15e8c729cff864d065ef3402a48bdee8d"} Jul 09 14:33:42.259825 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:42.259798 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:33:42.333364 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:42.333326 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qdf8n" event={"ID":"e9a24882-b0bb-46de-93c9-e2b9caa49bd6","Type":"ContainerStarted","Data":"600fd6f7c42f77b31be812c4af5a7476ddb669318fecfc371b449413309d7fd7"} Jul 09 14:33:44.341092 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:44.341051 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qdf8n" event={"ID":"e9a24882-b0bb-46de-93c9-e2b9caa49bd6","Type":"ContainerStarted","Data":"767b3113d2c0fb0365f74184c0ac183ac3184ad74e142975c0863a922e46472c"} Jul 09 14:33:44.363206 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:44.363157 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qdf8n" podStartSLOduration=33.451893453 podStartE2EDuration="40.36314437s" totalImagesPullingTime="6.911250917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:33:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:44.362290452 +0000 UTC m=+124.147134512" watchObservedRunningTime="2026-07-09 14:33:44.36314437 +0000 UTC m=+124.147988395" Jul 09 14:33:50.628926 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:50.628892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:33:50.631295 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:50.631275 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7e3791a-647d-4eba-a8e7-820a07879e4e-metrics-certs\") pod \"network-metrics-daemon-5979f\" (UID: \"b7e3791a-647d-4eba-a8e7-820a07879e4e\") " pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:33:50.650243 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:50.650216 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cdbbf6f54-7sgbl"] Jul 09 14:33:50.765907 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:50.765876 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-txwkz\"" Jul 09 14:33:50.773118 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:50.773094 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5979f" Jul 09 14:33:50.898550 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:50.898360 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5979f"] Jul 09 14:33:50.900987 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:33:50.900956 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e3791a_647d_4eba_a8e7_820a07879e4e.slice/crio-e19fb9cb77acb3f48d38661a807cd3395c6ad3123b1869acccf1bec68abf67ac WatchSource:0}: Error finding container e19fb9cb77acb3f48d38661a807cd3395c6ad3123b1869acccf1bec68abf67ac: Status 404 returned error can't find the container with id e19fb9cb77acb3f48d38661a807cd3395c6ad3123b1869acccf1bec68abf67ac Jul 09 14:33:51.364813 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:51.364775 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5979f" event={"ID":"b7e3791a-647d-4eba-a8e7-820a07879e4e","Type":"ContainerStarted","Data":"e19fb9cb77acb3f48d38661a807cd3395c6ad3123b1869acccf1bec68abf67ac"} Jul 09 14:33:52.899727 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.899670 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h87pt"] Jul 09 14:33:52.904082 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.904059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:52.907434 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.907413 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:33:52.907667 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.907651 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:33:52.907962 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.907948 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:33:52.909140 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.909122 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wccg6\"" Jul 09 14:33:52.909366 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.909346 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:33:52.909487 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.909347 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:33:52.909804 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.909785 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:33:52.946337 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.946309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-tls\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:52.946482 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.946356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1686660c-742d-473b-afe3-4c37d902464e-metrics-client-ca\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:52.946482 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.946390 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-accelerators-collector-config\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:52.946482 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.946419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkj5r\" (UniqueName: \"kubernetes.io/projected/1686660c-742d-473b-afe3-4c37d902464e-kube-api-access-xkj5r\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:52.946482 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.946452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1686660c-742d-473b-afe3-4c37d902464e-sys\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:52.946696 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.946483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-wtmp\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:52.946696 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.946509 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:52.946696 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.946535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1686660c-742d-473b-afe3-4c37d902464e-root\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:52.946696 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:52.946567 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-textfile\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.047814 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.047775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-wtmp\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048002 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.047826 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048002 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.047858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1686660c-742d-473b-afe3-4c37d902464e-root\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048002 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.047893 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-textfile\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048002 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.047926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-tls\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048002 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.047961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1686660c-742d-473b-afe3-4c37d902464e-metrics-client-ca\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048002 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.047974 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1686660c-742d-473b-afe3-4c37d902464e-root\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048002 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.047974 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-wtmp\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048002 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.047991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-accelerators-collector-config\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048385 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.048040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkj5r\" (UniqueName: \"kubernetes.io/projected/1686660c-742d-473b-afe3-4c37d902464e-kube-api-access-xkj5r\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048385 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:53.048062 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 14:33:53.048385 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.048083 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1686660c-742d-473b-afe3-4c37d902464e-sys\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048385 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:33:53.048126 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-tls podName:1686660c-742d-473b-afe3-4c37d902464e nodeName:}" failed. No retries permitted until 2026-07-09 14:33:53.548103846 +0000 UTC m=+133.332947881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-tls") pod "node-exporter-h87pt" (UID: "1686660c-742d-473b-afe3-4c37d902464e") : secret "node-exporter-tls" not found Jul 09 14:33:53.048385 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.048152 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1686660c-742d-473b-afe3-4c37d902464e-sys\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048617 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.048598 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-accelerators-collector-config\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048617 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.048604 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-textfile\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.048803 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.048786 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1686660c-742d-473b-afe3-4c37d902464e-metrics-client-ca\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.050764 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.050741 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.058312 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.058292 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkj5r\" (UniqueName: \"kubernetes.io/projected/1686660c-742d-473b-afe3-4c37d902464e-kube-api-access-xkj5r\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.374735 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.374700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5979f" event={"ID":"b7e3791a-647d-4eba-a8e7-820a07879e4e","Type":"ContainerStarted","Data":"9617c9d66bdcb2e958f7711d1a733abc5c2e6e0d446697cb2dc8789d86fcc476"} Jul 09 14:33:53.374929 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.374750 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5979f" event={"ID":"b7e3791a-647d-4eba-a8e7-820a07879e4e","Type":"ContainerStarted","Data":"07fc093a66d7c17c89f1fdd7b3d3f2e47f472b45ea265e69f2cdf807e8330816"} Jul 09 14:33:53.399220 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.399173 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5979f" podStartSLOduration=130.967798525 podStartE2EDuration="2m12.399155614s" totalImagesPullingTime="1.431357089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:53.397718611 +0000 UTC m=+133.182562675" watchObservedRunningTime="2026-07-09 14:33:53.399155614 +0000 UTC m=+133.183999661" Jul 09 14:33:53.552360 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.552320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-tls\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.554633 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.554606 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1686660c-742d-473b-afe3-4c37d902464e-node-exporter-tls\") pod \"node-exporter-h87pt\" (UID: \"1686660c-742d-473b-afe3-4c37d902464e\") " pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.814867 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:53.814829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h87pt" Jul 09 14:33:53.829209 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:33:53.829181 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1686660c_742d_473b_afe3_4c37d902464e.slice/crio-b34c89426afdcb28cca62499a7c54c1da392a92e75d01dc970e815b1c989bf3b WatchSource:0}: Error finding container b34c89426afdcb28cca62499a7c54c1da392a92e75d01dc970e815b1c989bf3b: Status 404 returned error can't find the container with id b34c89426afdcb28cca62499a7c54c1da392a92e75d01dc970e815b1c989bf3b Jul 09 14:33:54.383303 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:54.383267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h87pt" event={"ID":"1686660c-742d-473b-afe3-4c37d902464e","Type":"ContainerStarted","Data":"b34c89426afdcb28cca62499a7c54c1da392a92e75d01dc970e815b1c989bf3b"} Jul 09 14:33:55.387613 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:55.387514 2565 generic.go:356] "Generic (PLEG): container finished" podID="1686660c-742d-473b-afe3-4c37d902464e" containerID="ca254fbaa79cd9e77c5f14faf43b4b62e78e1d5c43fa08064e154ccb1be61965" exitCode=0 Jul 09 14:33:55.388089 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:55.387603 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h87pt" event={"ID":"1686660c-742d-473b-afe3-4c37d902464e","Type":"ContainerDied","Data":"ca254fbaa79cd9e77c5f14faf43b4b62e78e1d5c43fa08064e154ccb1be61965"} Jul 09 14:33:56.393700 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:56.393645 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h87pt" event={"ID":"1686660c-742d-473b-afe3-4c37d902464e","Type":"ContainerStarted","Data":"75b0ed823f2c9f13233b24288fa515d2e1190e4e510fe855588307022e698aba"} Jul 09 14:33:56.394087 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:56.393721 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h87pt" event={"ID":"1686660c-742d-473b-afe3-4c37d902464e","Type":"ContainerStarted","Data":"ff6b851efa3c9af806e3bc7ac7cce4b720dddc0bae6dc334ee02e6587a1d0063"} Jul 09 14:33:56.418709 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:33:56.418644 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h87pt" podStartSLOduration=3.16928421 podStartE2EDuration="4.418628003s" totalImagesPullingTime="1.185398796s" totalInitContainerRuntime="63.944997ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:56.416700375 +0000 UTC m=+136.201544422" watchObservedRunningTime="2026-07-09 14:33:56.418628003 +0000 UTC m=+136.203472060" Jul 09 14:34:15.671584 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:15.671540 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" podUID="9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" containerName="registry" containerID="cri-o://c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341" gracePeriod=30 Jul 09 14:34:15.916502 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:15.916475 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:34:16.017478 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.017390 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-installation-pull-secrets\") pod \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " Jul 09 14:34:16.017478 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.017429 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") pod \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " Jul 09 14:34:16.017478 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.017465 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh9vq\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-kube-api-access-rh9vq\") pod \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " Jul 09 14:34:16.017732 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.017515 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-trusted-ca\") pod \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " Jul 09 14:34:16.017732 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.017541 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-ca-trust-extracted\") pod \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " Jul 09 14:34:16.017732 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.017563 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-image-registry-private-configuration\") pod \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " Jul 09 14:34:16.017732 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.017594 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-bound-sa-token\") pod \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " Jul 09 14:34:16.017732 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.017625 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-certificates\") pod \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\" (UID: \"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a\") " Jul 09 14:34:16.018079 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.018052 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:34:16.018170 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.018131 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:34:16.020096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.020058 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:34:16.020096 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.020077 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:34:16.020265 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.020227 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:34:16.020265 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.020234 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:34:16.020377 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.020358 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-kube-api-access-rh9vq" (OuterVolumeSpecName: "kube-api-access-rh9vq") pod "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a"). InnerVolumeSpecName "kube-api-access-rh9vq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:34:16.027031 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.027003 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" (UID: "9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:34:16.119102 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.119062 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-ca-trust-extracted\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:34:16.119102 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.119097 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-image-registry-private-configuration\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:34:16.119102 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.119108 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-bound-sa-token\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:34:16.119310 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.119117 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-certificates\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:34:16.119310 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.119127 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-installation-pull-secrets\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:34:16.119310 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.119136 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-registry-tls\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:34:16.119310 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.119143 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh9vq\" (UniqueName: \"kubernetes.io/projected/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-kube-api-access-rh9vq\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:34:16.119310 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.119151 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a-trusted-ca\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:34:16.457890 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.457857 2565 generic.go:356] "Generic (PLEG): container finished" podID="9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" containerID="c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341" exitCode=0 Jul 09 14:34:16.458049 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.457890 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" event={"ID":"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a","Type":"ContainerDied","Data":"c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341"} Jul 09 14:34:16.458049 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.457947 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" event={"ID":"9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a","Type":"ContainerDied","Data":"344e47cafe32bd7f113d9627396175c0d0b7b47d1f5f091f52c8cd9370436b3c"} Jul 09 14:34:16.458049 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.457967 2565 scope.go:117] "RemoveContainer" containerID="c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341" Jul 09 14:34:16.458049 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.457899 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdbbf6f54-7sgbl" Jul 09 14:34:16.466007 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.465991 2565 scope.go:117] "RemoveContainer" containerID="c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341" Jul 09 14:34:16.466252 ip-10-0-132-123 kubenswrapper[2565]: E0709 14:34:16.466232 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341\": container with ID starting with c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341 not found: ID does not exist" containerID="c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341" Jul 09 14:34:16.466306 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.466261 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341"} err="failed to get container status \"c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341\": rpc error: code = NotFound desc = could not find container \"c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341\": container with ID starting with c719b9e9ef94a9eb4008a4fd5e9568956b7177ad11cb653f4957ec4f889f8341 not found: ID does not exist" Jul 09 14:34:16.481438 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.481412 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cdbbf6f54-7sgbl"] Jul 09 14:34:16.485822 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.485803 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cdbbf6f54-7sgbl"] Jul 09 14:34:16.840460 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:34:16.840380 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" path="/var/lib/kubelet/pods/9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a/volumes" Jul 09 14:36:19.774954 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.774873 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86"] Jul 09 14:36:19.775413 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.775131 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" containerName="registry" Jul 09 14:36:19.775413 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.775144 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" containerName="registry" Jul 09 14:36:19.775413 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.775195 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dbf0e0c-2822-4f61-8f98-c6c8c89bab2a" containerName="registry" Jul 09 14:36:19.778071 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.778055 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:19.781561 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.781540 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 14:36:19.781690 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.781629 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 14:36:19.783171 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.783150 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qffd9\"" Jul 09 14:36:19.792729 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.792706 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86"] Jul 09 14:36:19.862144 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.862118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:19.862291 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.862153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44s5t\" (UniqueName: \"kubernetes.io/projected/1844f026-2cfb-4bd5-942d-c7698c5948bc-kube-api-access-44s5t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:19.862291 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.862220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:19.963205 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.963177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:19.963363 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.963222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:19.963363 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.963243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44s5t\" (UniqueName: \"kubernetes.io/projected/1844f026-2cfb-4bd5-942d-c7698c5948bc-kube-api-access-44s5t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:19.963563 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.963541 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:19.963635 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.963590 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:19.973082 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:19.973060 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44s5t\" (UniqueName: \"kubernetes.io/projected/1844f026-2cfb-4bd5-942d-c7698c5948bc-kube-api-access-44s5t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:20.087101 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:20.087025 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:20.207810 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:20.207778 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86"] Jul 09 14:36:20.211982 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:36:20.211956 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1844f026_2cfb_4bd5_942d_c7698c5948bc.slice/crio-b7abce3b1f58e2fd27fed8cb0628eb24f862c675a21aaa9cd8d2db1bbf320705 WatchSource:0}: Error finding container b7abce3b1f58e2fd27fed8cb0628eb24f862c675a21aaa9cd8d2db1bbf320705: Status 404 returned error can't find the container with id b7abce3b1f58e2fd27fed8cb0628eb24f862c675a21aaa9cd8d2db1bbf320705 Jul 09 14:36:20.856190 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:20.856112 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" event={"ID":"1844f026-2cfb-4bd5-942d-c7698c5948bc","Type":"ContainerStarted","Data":"b7abce3b1f58e2fd27fed8cb0628eb24f862c675a21aaa9cd8d2db1bbf320705"} Jul 09 14:36:26.878967 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:26.878877 2565 generic.go:356] "Generic (PLEG): container finished" podID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerID="10eef69eae033e9c78af3d4397b7371d9d7934004cd3849bf4a0ed93de5b2ee7" exitCode=0 Jul 09 14:36:26.879303 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:26.878959 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" event={"ID":"1844f026-2cfb-4bd5-942d-c7698c5948bc","Type":"ContainerDied","Data":"10eef69eae033e9c78af3d4397b7371d9d7934004cd3849bf4a0ed93de5b2ee7"} Jul 09 14:36:31.897230 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:31.897194 2565 generic.go:356] "Generic (PLEG): container finished" podID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerID="48a2368c492d7197c600348b6916c8b5c631dec01888bd9a8be0506e0f0362fe" exitCode=0 Jul 09 14:36:31.897230 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:31.897223 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" event={"ID":"1844f026-2cfb-4bd5-942d-c7698c5948bc","Type":"ContainerDied","Data":"48a2368c492d7197c600348b6916c8b5c631dec01888bd9a8be0506e0f0362fe"} Jul 09 14:36:40.646664 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:40.646640 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt4vr_4bfdb2d6-4c5e-476a-8d63-43b25e66940a/ovn-acl-logging/0.log" Jul 09 14:36:40.649910 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:40.649831 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt4vr_4bfdb2d6-4c5e-476a-8d63-43b25e66940a/ovn-acl-logging/0.log" Jul 09 14:36:40.653727 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:40.653708 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 14:36:40.933064 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:40.933033 2565 generic.go:356] "Generic (PLEG): container finished" podID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerID="f2b7eef469171fe3d9e3b2c48e693f2daae1713dcc3a0732c2cc050994fd8369" exitCode=0 Jul 09 14:36:40.936855 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:40.933118 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" event={"ID":"1844f026-2cfb-4bd5-942d-c7698c5948bc","Type":"ContainerDied","Data":"f2b7eef469171fe3d9e3b2c48e693f2daae1713dcc3a0732c2cc050994fd8369"} Jul 09 14:36:42.079581 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.079551 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:42.231630 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.231545 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44s5t\" (UniqueName: \"kubernetes.io/projected/1844f026-2cfb-4bd5-942d-c7698c5948bc-kube-api-access-44s5t\") pod \"1844f026-2cfb-4bd5-942d-c7698c5948bc\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " Jul 09 14:36:42.231630 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.231604 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-bundle\") pod \"1844f026-2cfb-4bd5-942d-c7698c5948bc\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " Jul 09 14:36:42.231873 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.231661 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-util\") pod \"1844f026-2cfb-4bd5-942d-c7698c5948bc\" (UID: \"1844f026-2cfb-4bd5-942d-c7698c5948bc\") " Jul 09 14:36:42.232277 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.232254 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-bundle" (OuterVolumeSpecName: "bundle") pod "1844f026-2cfb-4bd5-942d-c7698c5948bc" (UID: "1844f026-2cfb-4bd5-942d-c7698c5948bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:36:42.234068 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.234048 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1844f026-2cfb-4bd5-942d-c7698c5948bc-kube-api-access-44s5t" (OuterVolumeSpecName: "kube-api-access-44s5t") pod "1844f026-2cfb-4bd5-942d-c7698c5948bc" (UID: "1844f026-2cfb-4bd5-942d-c7698c5948bc"). InnerVolumeSpecName "kube-api-access-44s5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:36:42.237536 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.237509 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-util" (OuterVolumeSpecName: "util") pod "1844f026-2cfb-4bd5-942d-c7698c5948bc" (UID: "1844f026-2cfb-4bd5-942d-c7698c5948bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:36:42.332813 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.332780 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-util\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:36:42.332813 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.332806 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44s5t\" (UniqueName: \"kubernetes.io/projected/1844f026-2cfb-4bd5-942d-c7698c5948bc-kube-api-access-44s5t\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:36:42.332813 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.332817 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1844f026-2cfb-4bd5-942d-c7698c5948bc-bundle\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:36:42.944322 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.944286 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" event={"ID":"1844f026-2cfb-4bd5-942d-c7698c5948bc","Type":"ContainerDied","Data":"b7abce3b1f58e2fd27fed8cb0628eb24f862c675a21aaa9cd8d2db1bbf320705"} Jul 09 14:36:42.944322 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.944312 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409th86" Jul 09 14:36:42.944508 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:42.944341 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7abce3b1f58e2fd27fed8cb0628eb24f862c675a21aaa9cd8d2db1bbf320705" Jul 09 14:36:47.997502 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:47.997473 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6"] Jul 09 14:36:47.997917 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:47.997699 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerName="extract" Jul 09 14:36:47.997917 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:47.997711 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerName="extract" Jul 09 14:36:47.997917 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:47.997721 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerName="util" Jul 09 14:36:47.997917 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:47.997727 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerName="util" Jul 09 14:36:47.997917 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:47.997734 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerName="pull" Jul 09 14:36:47.997917 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:47.997740 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerName="pull" Jul 09 14:36:47.997917 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:47.997781 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1844f026-2cfb-4bd5-942d-c7698c5948bc" containerName="extract" Jul 09 14:36:48.000687 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.000662 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" Jul 09 14:36:48.004103 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.004079 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:36:48.004227 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.004082 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tsx89\"" Jul 09 14:36:48.004227 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.004125 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 14:36:48.018803 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.018776 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6"] Jul 09 14:36:48.173977 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.173945 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2abe658d-96cd-42cb-b33e-e968731cc79f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj6b6\" (UID: \"2abe658d-96cd-42cb-b33e-e968731cc79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" Jul 09 14:36:48.174127 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.173986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w75f\" (UniqueName: \"kubernetes.io/projected/2abe658d-96cd-42cb-b33e-e968731cc79f-kube-api-access-4w75f\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj6b6\" (UID: \"2abe658d-96cd-42cb-b33e-e968731cc79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" Jul 09 14:36:48.275074 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.274999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2abe658d-96cd-42cb-b33e-e968731cc79f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj6b6\" (UID: \"2abe658d-96cd-42cb-b33e-e968731cc79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" Jul 09 14:36:48.275074 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.275039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w75f\" (UniqueName: \"kubernetes.io/projected/2abe658d-96cd-42cb-b33e-e968731cc79f-kube-api-access-4w75f\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj6b6\" (UID: \"2abe658d-96cd-42cb-b33e-e968731cc79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" Jul 09 14:36:48.275413 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.275393 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2abe658d-96cd-42cb-b33e-e968731cc79f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj6b6\" (UID: \"2abe658d-96cd-42cb-b33e-e968731cc79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" Jul 09 14:36:48.286066 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.286042 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w75f\" (UniqueName: \"kubernetes.io/projected/2abe658d-96cd-42cb-b33e-e968731cc79f-kube-api-access-4w75f\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj6b6\" (UID: \"2abe658d-96cd-42cb-b33e-e968731cc79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" Jul 09 14:36:48.308974 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.308951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" Jul 09 14:36:48.433783 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.433738 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6"] Jul 09 14:36:48.437478 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:36:48.437444 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abe658d_96cd_42cb_b33e_e968731cc79f.slice/crio-45d8810bdaaba6b6084abcc39abda893f6bd0cc2f2c82c2b823233b621c46f9c WatchSource:0}: Error finding container 45d8810bdaaba6b6084abcc39abda893f6bd0cc2f2c82c2b823233b621c46f9c: Status 404 returned error can't find the container with id 45d8810bdaaba6b6084abcc39abda893f6bd0cc2f2c82c2b823233b621c46f9c Jul 09 14:36:48.440074 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.440058 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:36:48.965705 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:48.965649 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" event={"ID":"2abe658d-96cd-42cb-b33e-e968731cc79f","Type":"ContainerStarted","Data":"45d8810bdaaba6b6084abcc39abda893f6bd0cc2f2c82c2b823233b621c46f9c"} Jul 09 14:36:50.974041 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:50.974003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" event={"ID":"2abe658d-96cd-42cb-b33e-e968731cc79f","Type":"ContainerStarted","Data":"34e54e96d7bb412450b30e742ee40310f94adddb1f2795e2e63c53cbb80a24ac"} Jul 09 14:36:50.996739 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:50.996692 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj6b6" podStartSLOduration=2.447978173 podStartE2EDuration="3.996652039s" totalImagesPullingTime="1.548673866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:36:50.9949752 +0000 UTC m=+310.779819246" watchObservedRunningTime="2026-07-09 14:36:50.996652039 +0000 UTC m=+310.781496086" Jul 09 14:36:52.122605 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.122571 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h"] Jul 09 14:36:52.125870 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.125855 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.129784 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.129759 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 14:36:52.129897 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.129847 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 14:36:52.131398 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.131381 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qffd9\"" Jul 09 14:36:52.138079 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.138059 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h"] Jul 09 14:36:52.306930 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.306898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.306930 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.306935 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.307145 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.306981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rp7\" (UniqueName: \"kubernetes.io/projected/cf244924-8e38-4626-b8a0-e3af7bce33c0-kube-api-access-f4rp7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.407329 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.407251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rp7\" (UniqueName: \"kubernetes.io/projected/cf244924-8e38-4626-b8a0-e3af7bce33c0-kube-api-access-f4rp7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.407329 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.407293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.407329 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.407315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.407654 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.407637 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.407720 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.407667 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.417315 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.417283 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rp7\" (UniqueName: \"kubernetes.io/projected/cf244924-8e38-4626-b8a0-e3af7bce33c0-kube-api-access-f4rp7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.434722 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.434704 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:52.567239 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.567213 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h"] Jul 09 14:36:52.569476 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:36:52.569438 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf244924_8e38_4626_b8a0_e3af7bce33c0.slice/crio-9530ca02d07c316992351fd372cb917c3fb14c286463489aadbc0410469632c1 WatchSource:0}: Error finding container 9530ca02d07c316992351fd372cb917c3fb14c286463489aadbc0410469632c1: Status 404 returned error can't find the container with id 9530ca02d07c316992351fd372cb917c3fb14c286463489aadbc0410469632c1 Jul 09 14:36:52.982212 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.982176 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerID="3f21f23e7530e6a0a52a040e99e186c81c95158d251593eee3286b4c7e63d74e" exitCode=0 Jul 09 14:36:52.982366 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.982216 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" event={"ID":"cf244924-8e38-4626-b8a0-e3af7bce33c0","Type":"ContainerDied","Data":"3f21f23e7530e6a0a52a040e99e186c81c95158d251593eee3286b4c7e63d74e"} Jul 09 14:36:52.982366 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:52.982250 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" event={"ID":"cf244924-8e38-4626-b8a0-e3af7bce33c0","Type":"ContainerStarted","Data":"9530ca02d07c316992351fd372cb917c3fb14c286463489aadbc0410469632c1"} Jul 09 14:36:54.991149 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:54.991070 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerID="78092d063a5fb39fe72776cc01c221c6b9baa3a8980370af71e071b12452be30" exitCode=0 Jul 09 14:36:54.991149 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:54.991140 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" event={"ID":"cf244924-8e38-4626-b8a0-e3af7bce33c0","Type":"ContainerDied","Data":"78092d063a5fb39fe72776cc01c221c6b9baa3a8980370af71e071b12452be30"} Jul 09 14:36:55.996719 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:55.996654 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerID="14b10463aa17fb5e598244bc4fbc41214b75f813131faeae51bd00bddfc15cfe" exitCode=0 Jul 09 14:36:55.996719 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:55.996721 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" event={"ID":"cf244924-8e38-4626-b8a0-e3af7bce33c0","Type":"ContainerDied","Data":"14b10463aa17fb5e598244bc4fbc41214b75f813131faeae51bd00bddfc15cfe"} Jul 09 14:36:57.115502 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.115477 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:57.243340 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.243303 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-util\") pod \"cf244924-8e38-4626-b8a0-e3af7bce33c0\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " Jul 09 14:36:57.243530 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.243348 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4rp7\" (UniqueName: \"kubernetes.io/projected/cf244924-8e38-4626-b8a0-e3af7bce33c0-kube-api-access-f4rp7\") pod \"cf244924-8e38-4626-b8a0-e3af7bce33c0\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " Jul 09 14:36:57.243530 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.243387 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-bundle\") pod \"cf244924-8e38-4626-b8a0-e3af7bce33c0\" (UID: \"cf244924-8e38-4626-b8a0-e3af7bce33c0\") " Jul 09 14:36:57.243853 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.243817 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-bundle" (OuterVolumeSpecName: "bundle") pod "cf244924-8e38-4626-b8a0-e3af7bce33c0" (UID: "cf244924-8e38-4626-b8a0-e3af7bce33c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:36:57.245423 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.245402 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf244924-8e38-4626-b8a0-e3af7bce33c0-kube-api-access-f4rp7" (OuterVolumeSpecName: "kube-api-access-f4rp7") pod "cf244924-8e38-4626-b8a0-e3af7bce33c0" (UID: "cf244924-8e38-4626-b8a0-e3af7bce33c0"). InnerVolumeSpecName "kube-api-access-f4rp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:36:57.248723 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.248671 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-util" (OuterVolumeSpecName: "util") pod "cf244924-8e38-4626-b8a0-e3af7bce33c0" (UID: "cf244924-8e38-4626-b8a0-e3af7bce33c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:36:57.344279 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.344192 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-bundle\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:36:57.344279 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.344220 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf244924-8e38-4626-b8a0-e3af7bce33c0-util\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:36:57.344279 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:57.344228 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4rp7\" (UniqueName: \"kubernetes.io/projected/cf244924-8e38-4626-b8a0-e3af7bce33c0-kube-api-access-f4rp7\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:36:58.004599 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:58.004573 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" Jul 09 14:36:58.004776 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:58.004570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvhv9h" event={"ID":"cf244924-8e38-4626-b8a0-e3af7bce33c0","Type":"ContainerDied","Data":"9530ca02d07c316992351fd372cb917c3fb14c286463489aadbc0410469632c1"} Jul 09 14:36:58.004776 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:36:58.004705 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9530ca02d07c316992351fd372cb917c3fb14c286463489aadbc0410469632c1" Jul 09 14:37:00.137804 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.137769 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t27zt"] Jul 09 14:37:00.138136 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.137988 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerName="util" Jul 09 14:37:00.138136 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.137998 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerName="util" Jul 09 14:37:00.138136 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.138005 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerName="pull" Jul 09 14:37:00.138136 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.138011 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerName="pull" Jul 09 14:37:00.138136 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.138016 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerName="extract" Jul 09 14:37:00.138136 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.138022 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerName="extract" Jul 09 14:37:00.138136 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.138065 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf244924-8e38-4626-b8a0-e3af7bce33c0" containerName="extract" Jul 09 14:37:00.140853 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.140836 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:00.143968 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.143950 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 14:37:00.144080 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.143972 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 14:37:00.145432 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.145415 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ht8qh\"" Jul 09 14:37:00.150569 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.150541 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t27zt"] Jul 09 14:37:00.263977 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.263944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87t27\" (UniqueName: \"kubernetes.io/projected/9c5ab0a2-119b-4abe-bb63-22160ff057f2-kube-api-access-87t27\") pod \"cert-manager-webhook-6486ffd997-t27zt\" (UID: \"9c5ab0a2-119b-4abe-bb63-22160ff057f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:00.264134 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.264021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c5ab0a2-119b-4abe-bb63-22160ff057f2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t27zt\" (UID: \"9c5ab0a2-119b-4abe-bb63-22160ff057f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:00.365033 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.365005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87t27\" (UniqueName: \"kubernetes.io/projected/9c5ab0a2-119b-4abe-bb63-22160ff057f2-kube-api-access-87t27\") pod \"cert-manager-webhook-6486ffd997-t27zt\" (UID: \"9c5ab0a2-119b-4abe-bb63-22160ff057f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:00.365145 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.365040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c5ab0a2-119b-4abe-bb63-22160ff057f2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t27zt\" (UID: \"9c5ab0a2-119b-4abe-bb63-22160ff057f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:00.373724 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.373700 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c5ab0a2-119b-4abe-bb63-22160ff057f2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t27zt\" (UID: \"9c5ab0a2-119b-4abe-bb63-22160ff057f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:00.373847 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.373832 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87t27\" (UniqueName: \"kubernetes.io/projected/9c5ab0a2-119b-4abe-bb63-22160ff057f2-kube-api-access-87t27\") pod \"cert-manager-webhook-6486ffd997-t27zt\" (UID: \"9c5ab0a2-119b-4abe-bb63-22160ff057f2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:00.449798 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.449774 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:00.573056 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:00.573026 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t27zt"] Jul 09 14:37:00.576582 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:37:00.576557 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c5ab0a2_119b_4abe_bb63_22160ff057f2.slice/crio-e86f5e31ca0ace232cdcb38c3c5cff9a76915db0190279450ffba6f61f891f55 WatchSource:0}: Error finding container e86f5e31ca0ace232cdcb38c3c5cff9a76915db0190279450ffba6f61f891f55: Status 404 returned error can't find the container with id e86f5e31ca0ace232cdcb38c3c5cff9a76915db0190279450ffba6f61f891f55 Jul 09 14:37:01.016929 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:01.016895 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" event={"ID":"9c5ab0a2-119b-4abe-bb63-22160ff057f2","Type":"ContainerStarted","Data":"e86f5e31ca0ace232cdcb38c3c5cff9a76915db0190279450ffba6f61f891f55"} Jul 09 14:37:04.029235 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:04.029197 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" event={"ID":"9c5ab0a2-119b-4abe-bb63-22160ff057f2","Type":"ContainerStarted","Data":"10e0c956a161eced0bba34b980302a8ee1bcb9a379c3e5ba9b492700b1f9785e"} Jul 09 14:37:04.029719 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:04.029342 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:04.046017 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:04.045971 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" podStartSLOduration=1.365836615 podStartE2EDuration="4.045958596s" totalImagesPullingTime="2.680121981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:37:04.044879528 +0000 UTC m=+323.829723574" watchObservedRunningTime="2026-07-09 14:37:04.045958596 +0000 UTC m=+323.830802643" Jul 09 14:37:10.035200 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:10.035163 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-t27zt" Jul 09 14:37:11.145486 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.145442 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp"] Jul 09 14:37:11.165036 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.165006 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp"] Jul 09 14:37:11.165181 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.165136 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.168255 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.168231 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qffd9\"" Jul 09 14:37:11.168356 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.168254 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 14:37:11.169722 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.169703 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 14:37:11.342062 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.342025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvm87\" (UniqueName: \"kubernetes.io/projected/da43d8c8-fc0e-4eba-b195-b1604bd403aa-kube-api-access-cvm87\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.342235 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.342071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.342235 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.342107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.443198 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.443170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvm87\" (UniqueName: \"kubernetes.io/projected/da43d8c8-fc0e-4eba-b195-b1604bd403aa-kube-api-access-cvm87\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.443347 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.443227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.443347 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.443249 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.443595 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.443579 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.443628 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.443602 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.451726 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.451701 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvm87\" (UniqueName: \"kubernetes.io/projected/da43d8c8-fc0e-4eba-b195-b1604bd403aa-kube-api-access-cvm87\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.473533 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.473511 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:11.616001 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:11.615977 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp"] Jul 09 14:37:11.618829 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:37:11.618792 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda43d8c8_fc0e_4eba_b195_b1604bd403aa.slice/crio-bce5a863ce83acbcc6c634a5019c1f1f91c905de175aff9e16fb709f045db7ac WatchSource:0}: Error finding container bce5a863ce83acbcc6c634a5019c1f1f91c905de175aff9e16fb709f045db7ac: Status 404 returned error can't find the container with id bce5a863ce83acbcc6c634a5019c1f1f91c905de175aff9e16fb709f045db7ac Jul 09 14:37:12.059383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:12.059298 2565 generic.go:356] "Generic (PLEG): container finished" podID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerID="5f5134e1ae34a6bfb2370bbee50295b68ef036c9f22b6064c8b3785be87ea91a" exitCode=0 Jul 09 14:37:12.059383 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:12.059348 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" event={"ID":"da43d8c8-fc0e-4eba-b195-b1604bd403aa","Type":"ContainerDied","Data":"5f5134e1ae34a6bfb2370bbee50295b68ef036c9f22b6064c8b3785be87ea91a"} Jul 09 14:37:12.059561 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:12.059385 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" event={"ID":"da43d8c8-fc0e-4eba-b195-b1604bd403aa","Type":"ContainerStarted","Data":"bce5a863ce83acbcc6c634a5019c1f1f91c905de175aff9e16fb709f045db7ac"} Jul 09 14:37:14.068516 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:14.068480 2565 generic.go:356] "Generic (PLEG): container finished" podID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerID="b5253ec9f7486e0665009752bb3dd5879e68c3392a3f394d73a25905f91b9c7e" exitCode=0 Jul 09 14:37:14.068907 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:14.068557 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" event={"ID":"da43d8c8-fc0e-4eba-b195-b1604bd403aa","Type":"ContainerDied","Data":"b5253ec9f7486e0665009752bb3dd5879e68c3392a3f394d73a25905f91b9c7e"} Jul 09 14:37:15.074480 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:15.074444 2565 generic.go:356] "Generic (PLEG): container finished" podID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerID="bc46ce7100331a3901b8eed01bd65a614679ba83f6e983cf93a53637f72290ee" exitCode=0 Jul 09 14:37:15.074875 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:15.074504 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" event={"ID":"da43d8c8-fc0e-4eba-b195-b1604bd403aa","Type":"ContainerDied","Data":"bc46ce7100331a3901b8eed01bd65a614679ba83f6e983cf93a53637f72290ee"} Jul 09 14:37:16.201664 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.201642 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:16.275195 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.275165 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-util\") pod \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " Jul 09 14:37:16.275318 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.275223 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvm87\" (UniqueName: \"kubernetes.io/projected/da43d8c8-fc0e-4eba-b195-b1604bd403aa-kube-api-access-cvm87\") pod \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " Jul 09 14:37:16.275318 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.275262 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-bundle\") pod \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\" (UID: \"da43d8c8-fc0e-4eba-b195-b1604bd403aa\") " Jul 09 14:37:16.275974 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.275948 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-bundle" (OuterVolumeSpecName: "bundle") pod "da43d8c8-fc0e-4eba-b195-b1604bd403aa" (UID: "da43d8c8-fc0e-4eba-b195-b1604bd403aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:16.277288 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.277257 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da43d8c8-fc0e-4eba-b195-b1604bd403aa-kube-api-access-cvm87" (OuterVolumeSpecName: "kube-api-access-cvm87") pod "da43d8c8-fc0e-4eba-b195-b1604bd403aa" (UID: "da43d8c8-fc0e-4eba-b195-b1604bd403aa"). InnerVolumeSpecName "kube-api-access-cvm87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:37:16.281246 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.281224 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-util" (OuterVolumeSpecName: "util") pod "da43d8c8-fc0e-4eba-b195-b1604bd403aa" (UID: "da43d8c8-fc0e-4eba-b195-b1604bd403aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:16.375710 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.375635 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-util\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:37:16.375710 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.375656 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvm87\" (UniqueName: \"kubernetes.io/projected/da43d8c8-fc0e-4eba-b195-b1604bd403aa-kube-api-access-cvm87\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:37:16.375710 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:16.375666 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da43d8c8-fc0e-4eba-b195-b1604bd403aa-bundle\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:37:17.084430 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:17.084398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" event={"ID":"da43d8c8-fc0e-4eba-b195-b1604bd403aa","Type":"ContainerDied","Data":"bce5a863ce83acbcc6c634a5019c1f1f91c905de175aff9e16fb709f045db7ac"} Jul 09 14:37:17.084581 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:17.084431 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affncpp" Jul 09 14:37:17.084581 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:17.084488 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bce5a863ce83acbcc6c634a5019c1f1f91c905de175aff9e16fb709f045db7ac" Jul 09 14:37:27.198646 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.198612 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55"] Jul 09 14:37:27.199095 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.198848 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerName="extract" Jul 09 14:37:27.199095 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.198859 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerName="extract" Jul 09 14:37:27.199095 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.198879 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerName="pull" Jul 09 14:37:27.199095 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.198886 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerName="pull" Jul 09 14:37:27.199095 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.198894 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerName="util" Jul 09 14:37:27.199095 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.198899 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerName="util" Jul 09 14:37:27.199095 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.198938 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da43d8c8-fc0e-4eba-b195-b1604bd403aa" containerName="extract" Jul 09 14:37:27.205172 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.205152 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.210148 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.210117 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 14:37:27.210278 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.210117 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xc875\"" Jul 09 14:37:27.210278 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.210117 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:37:27.210393 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.210117 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 14:37:27.210393 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.210122 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 14:37:27.212068 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.212045 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 14:37:27.213384 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.213147 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55"] Jul 09 14:37:27.248324 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.248295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-manager-config\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.248468 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.248333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-metrics-cert\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.248468 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.248363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm664\" (UniqueName: \"kubernetes.io/projected/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-kube-api-access-lm664\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.248468 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.248421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-cert\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.349015 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.348979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm664\" (UniqueName: \"kubernetes.io/projected/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-kube-api-access-lm664\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.349015 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.349019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-cert\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.349261 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.349048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-manager-config\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.349261 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.349084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-metrics-cert\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.349782 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.349756 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-manager-config\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.351563 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.351531 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-cert\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.351656 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.351614 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-metrics-cert\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.359827 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.359802 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm664\" (UniqueName: \"kubernetes.io/projected/fc6177c0-b7ab-4d97-a5a6-0bddb63f4827-kube-api-access-lm664\") pod \"lws-controller-manager-746b95fc8f-wfz55\" (UID: \"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827\") " pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.516511 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.516433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:27.640531 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:27.640491 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55"] Jul 09 14:37:27.642607 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:37:27.642584 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6177c0_b7ab_4d97_a5a6_0bddb63f4827.slice/crio-ac921eddee6c7b7b9e755ce167fd5950e591f7b7c4cc57adbf86231caa1877fc WatchSource:0}: Error finding container ac921eddee6c7b7b9e755ce167fd5950e591f7b7c4cc57adbf86231caa1877fc: Status 404 returned error can't find the container with id ac921eddee6c7b7b9e755ce167fd5950e591f7b7c4cc57adbf86231caa1877fc Jul 09 14:37:28.125696 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.125638 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" event={"ID":"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827","Type":"ContainerStarted","Data":"ac921eddee6c7b7b9e755ce167fd5950e591f7b7c4cc57adbf86231caa1877fc"} Jul 09 14:37:28.456342 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.456313 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf"] Jul 09 14:37:28.460739 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.460720 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.465292 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.465272 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 14:37:28.466119 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.466101 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 14:37:28.466224 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.466208 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kkz68\"" Jul 09 14:37:28.466353 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.466332 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 14:37:28.466594 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.466580 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 14:37:28.499033 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.499007 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf"] Jul 09 14:37:28.559047 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.558963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0744062a-c3cc-493e-bcf6-f188b1378a07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.559247 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.559088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0744062a-c3cc-493e-bcf6-f188b1378a07-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.559247 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.559181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0744062a-c3cc-493e-bcf6-f188b1378a07-tmp\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.559247 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.559225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t577q\" (UniqueName: \"kubernetes.io/projected/0744062a-c3cc-493e-bcf6-f188b1378a07-kube-api-access-t577q\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.559408 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.559287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0744062a-c3cc-493e-bcf6-f188b1378a07-manifests\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.660123 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.660056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t577q\" (UniqueName: \"kubernetes.io/projected/0744062a-c3cc-493e-bcf6-f188b1378a07-kube-api-access-t577q\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.660304 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.660177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0744062a-c3cc-493e-bcf6-f188b1378a07-manifests\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.660304 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.660243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0744062a-c3cc-493e-bcf6-f188b1378a07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.660304 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.660276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0744062a-c3cc-493e-bcf6-f188b1378a07-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.660457 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.660345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0744062a-c3cc-493e-bcf6-f188b1378a07-tmp\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.660693 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.660651 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0744062a-c3cc-493e-bcf6-f188b1378a07-manifests\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.662883 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.662855 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0744062a-c3cc-493e-bcf6-f188b1378a07-tmp\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.663191 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.663167 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0744062a-c3cc-493e-bcf6-f188b1378a07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.663259 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.663215 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0744062a-c3cc-493e-bcf6-f188b1378a07-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.670671 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.670631 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t577q\" (UniqueName: \"kubernetes.io/projected/0744062a-c3cc-493e-bcf6-f188b1378a07-kube-api-access-t577q\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-db8vf\" (UID: \"0744062a-c3cc-493e-bcf6-f188b1378a07\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.770601 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.770526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:28.920434 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:28.920401 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf"] Jul 09 14:37:29.243304 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:37:29.243268 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0744062a_c3cc_493e_bcf6_f188b1378a07.slice/crio-6b9ad09f4e26f4da7277df7206261619f6035afd6f6577e60c8bb743d7d07ed9 WatchSource:0}: Error finding container 6b9ad09f4e26f4da7277df7206261619f6035afd6f6577e60c8bb743d7d07ed9: Status 404 returned error can't find the container with id 6b9ad09f4e26f4da7277df7206261619f6035afd6f6577e60c8bb743d7d07ed9 Jul 09 14:37:30.136960 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:30.136924 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" event={"ID":"fc6177c0-b7ab-4d97-a5a6-0bddb63f4827","Type":"ContainerStarted","Data":"9ff5183976e4130cf215f19bca2d8d2821a851a7c75c49d8af80eb566b54a187"} Jul 09 14:37:30.137419 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:30.137059 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:30.138491 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:30.138457 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" event={"ID":"0744062a-c3cc-493e-bcf6-f188b1378a07","Type":"ContainerStarted","Data":"6b9ad09f4e26f4da7277df7206261619f6035afd6f6577e60c8bb743d7d07ed9"} Jul 09 14:37:32.147508 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:32.147468 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" event={"ID":"0744062a-c3cc-493e-bcf6-f188b1378a07","Type":"ContainerStarted","Data":"91c0019ac44b6e1ba1fe36c1a03d6b30d98f7f73f1a72682cbeb93a68a031209"} Jul 09 14:37:32.175807 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:32.175759 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" podStartSLOduration=3.521557941 podStartE2EDuration="5.175744877s" totalImagesPullingTime="1.654186936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:37:30.170597188 +0000 UTC m=+349.955441236" watchObservedRunningTime="2026-07-09 14:37:32.175744877 +0000 UTC m=+351.960588924" Jul 09 14:37:34.157304 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:34.157267 2565 generic.go:356] "Generic (PLEG): container finished" podID="0744062a-c3cc-493e-bcf6-f188b1378a07" containerID="91c0019ac44b6e1ba1fe36c1a03d6b30d98f7f73f1a72682cbeb93a68a031209" exitCode=0 Jul 09 14:37:34.157721 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:34.157342 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" event={"ID":"0744062a-c3cc-493e-bcf6-f188b1378a07","Type":"ContainerDied","Data":"91c0019ac44b6e1ba1fe36c1a03d6b30d98f7f73f1a72682cbeb93a68a031209"} Jul 09 14:37:35.163600 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:35.163514 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" event={"ID":"0744062a-c3cc-493e-bcf6-f188b1378a07","Type":"ContainerStarted","Data":"118fadcd037aa9ba059f1c63db890fb78f16605511ac4b7d39d7d81c0bc72e58"} Jul 09 14:37:35.164049 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:35.163863 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:37:35.194542 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:35.194492 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" podStartSLOduration=2.6592977639999997 podStartE2EDuration="7.194478625s" totalImagesPullingTime="3.453294212s" totalInitContainerRuntime="1.081886649s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:37:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:37:35.192271868 +0000 UTC m=+354.977115914" watchObservedRunningTime="2026-07-09 14:37:35.194478625 +0000 UTC m=+354.979322671" Jul 09 14:37:41.144835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:41.144806 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-746b95fc8f-wfz55" Jul 09 14:37:46.169993 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:37:46.169949 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-db8vf" Jul 09 14:38:02.525557 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.525524 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq"] Jul 09 14:38:02.614701 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.614650 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq"] Jul 09 14:38:02.614877 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.614772 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.618300 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.618277 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 14:38:02.618430 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.618375 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wg7cp\"" Jul 09 14:38:02.713099 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.713066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.713099 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.713105 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.713344 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.713134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.713344 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.713182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.713344 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.713225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxpwj\" (UniqueName: \"kubernetes.io/projected/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-kube-api-access-fxpwj\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.713344 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.713304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.713344 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.713341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.713602 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.713372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.713602 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.713444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.814918 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.814845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.814918 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.814896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.814918 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.814918 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815198 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.814947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815198 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.814966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815198 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.814984 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxpwj\" (UniqueName: \"kubernetes.io/projected/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-kube-api-access-fxpwj\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815198 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.815011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815198 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.815174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815473 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.815227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815589 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.815548 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815695 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.815590 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815695 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.815633 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.815695 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.815694 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.816130 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.816109 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.817427 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.817405 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.817603 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.817587 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.826969 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.826944 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxpwj\" (UniqueName: \"kubernetes.io/projected/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-kube-api-access-fxpwj\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.827074 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.826976 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vt6lq\" (UID: \"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.924352 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.924312 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:02.927022 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.926994 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr"] Jul 09 14:38:02.939648 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.939625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:02.943308 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.943287 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2rmd6\"" Jul 09 14:38:02.943583 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.943569 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 14:38:02.944492 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.944476 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 14:38:02.944976 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.944958 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 14:38:02.962819 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:02.962796 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr"] Jul 09 14:38:03.016814 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.016780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/078ca648-67b7-4edf-aa30-89070efb537a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.016948 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.016831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/078ca648-67b7-4edf-aa30-89070efb537a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.016948 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.016903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpjb7\" (UniqueName: \"kubernetes.io/projected/078ca648-67b7-4edf-aa30-89070efb537a-kube-api-access-hpjb7\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.017046 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.016949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/078ca648-67b7-4edf-aa30-89070efb537a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.017046 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.016970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/078ca648-67b7-4edf-aa30-89070efb537a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.017150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.017050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/078ca648-67b7-4edf-aa30-89070efb537a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.017150 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.017078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/078ca648-67b7-4edf-aa30-89070efb537a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.067530 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.067507 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq"] Jul 09 14:38:03.069950 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:38:03.069913 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e6fbb2_f0b0_46f6_8bbc_ab6b91f3d45f.slice/crio-d7ead9d9950ee7245f4b5624f0b4e6f364ceb13987c9aca85b65271bd4848354 WatchSource:0}: Error finding container d7ead9d9950ee7245f4b5624f0b4e6f364ceb13987c9aca85b65271bd4848354: Status 404 returned error can't find the container with id d7ead9d9950ee7245f4b5624f0b4e6f364ceb13987c9aca85b65271bd4848354 Jul 09 14:38:03.118305 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.118281 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/078ca648-67b7-4edf-aa30-89070efb537a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.118397 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.118313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/078ca648-67b7-4edf-aa30-89070efb537a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.118397 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.118337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/078ca648-67b7-4edf-aa30-89070efb537a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.118397 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.118354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/078ca648-67b7-4edf-aa30-89070efb537a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.118550 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.118467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/078ca648-67b7-4edf-aa30-89070efb537a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.118550 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.118498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/078ca648-67b7-4edf-aa30-89070efb537a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.118550 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.118520 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpjb7\" (UniqueName: \"kubernetes.io/projected/078ca648-67b7-4edf-aa30-89070efb537a-kube-api-access-hpjb7\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.119225 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.119184 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/078ca648-67b7-4edf-aa30-89070efb537a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.120717 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.120693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/078ca648-67b7-4edf-aa30-89070efb537a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.120802 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.120696 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/078ca648-67b7-4edf-aa30-89070efb537a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.120802 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.120755 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/078ca648-67b7-4edf-aa30-89070efb537a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.120879 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.120825 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/078ca648-67b7-4edf-aa30-89070efb537a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.134958 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.134934 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpjb7\" (UniqueName: \"kubernetes.io/projected/078ca648-67b7-4edf-aa30-89070efb537a-kube-api-access-hpjb7\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.140349 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.140333 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/078ca648-67b7-4edf-aa30-89070efb537a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5nwjr\" (UID: \"078ca648-67b7-4edf-aa30-89070efb537a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.261505 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.261467 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:03.277959 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.277934 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" event={"ID":"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f","Type":"ContainerStarted","Data":"d7ead9d9950ee7245f4b5624f0b4e6f364ceb13987c9aca85b65271bd4848354"} Jul 09 14:38:03.396602 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:03.396580 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr"] Jul 09 14:38:03.398787 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:38:03.398762 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078ca648_67b7_4edf_aa30_89070efb537a.slice/crio-4e5395f1867ed787038c10067dd0bc1ecf33f515624d790a128925e6aee1afce WatchSource:0}: Error finding container 4e5395f1867ed787038c10067dd0bc1ecf33f515624d790a128925e6aee1afce: Status 404 returned error can't find the container with id 4e5395f1867ed787038c10067dd0bc1ecf33f515624d790a128925e6aee1afce Jul 09 14:38:04.283212 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:04.283158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" event={"ID":"078ca648-67b7-4edf-aa30-89070efb537a","Type":"ContainerStarted","Data":"4e5395f1867ed787038c10067dd0bc1ecf33f515624d790a128925e6aee1afce"} Jul 09 14:38:06.060936 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:06.060897 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 14:38:06.061200 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:06.060967 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 14:38:06.296306 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:06.296273 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" event={"ID":"078ca648-67b7-4edf-aa30-89070efb537a","Type":"ContainerStarted","Data":"e40d36e00feb84c0b53fefd9d5366fb7bb8369f482d72ade967aaeede6f3289e"} Jul 09 14:38:06.296473 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:06.296371 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:06.394148 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:06.394052 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" podStartSLOduration=1.7341178419999999 podStartE2EDuration="4.394035846s" totalImagesPullingTime="2.659918004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:06.379066842 +0000 UTC m=+386.163910888" watchObservedRunningTime="2026-07-09 14:38:06.394035846 +0000 UTC m=+386.178879893" Jul 09 14:38:07.302132 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:07.302105 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5nwjr" Jul 09 14:38:14.326202 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:14.326157 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 14:38:14.326488 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:14.326254 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 14:38:14.326488 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:14.326294 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 14:38:15.332951 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:15.332919 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" event={"ID":"64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f","Type":"ContainerStarted","Data":"fe1d82bfb518c79e84fab554851d9ff012e104d74a7277ed2444d6e3fcb356af"} Jul 09 14:38:15.925267 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:15.925228 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:15.929854 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:15.929826 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:15.962859 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:15.962797 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" podStartSLOduration=2.710225076 podStartE2EDuration="13.962776734s" totalImagesPullingTime="11.252551658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:15.370689484 +0000 UTC m=+395.155533523" watchObservedRunningTime="2026-07-09 14:38:15.962776734 +0000 UTC m=+395.747620781" Jul 09 14:38:16.336993 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:16.336901 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:38:16.337741 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:38:16.337725 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vt6lq" Jul 09 14:39:05.804419 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:05.804346 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5"] Jul 09 14:39:05.807641 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:05.807624 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:05.812110 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:05.812091 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:39:05.812426 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:05.812408 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:39:05.816788 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:05.816773 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bptl\"" Jul 09 14:39:05.830179 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:05.830158 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5"] Jul 09 14:39:05.903844 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:05.903817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:05.903983 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:05.903853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:05.903983 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:05.903878 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdcjc\" (UniqueName: \"kubernetes.io/projected/a24647c2-0553-486c-a909-fd221738be1c-kube-api-access-pdcjc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:06.004477 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.004439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:06.004653 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.004488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:06.004653 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.004523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdcjc\" (UniqueName: \"kubernetes.io/projected/a24647c2-0553-486c-a909-fd221738be1c-kube-api-access-pdcjc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:06.004916 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.004891 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:06.004982 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.004903 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:06.021479 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.021444 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdcjc\" (UniqueName: \"kubernetes.io/projected/a24647c2-0553-486c-a909-fd221738be1c-kube-api-access-pdcjc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:06.116767 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.116694 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:06.238275 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.238237 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576"] Jul 09 14:39:06.241743 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.241726 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.255463 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.255331 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5"] Jul 09 14:39:06.257990 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:39:06.257966 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24647c2_0553_486c_a909_fd221738be1c.slice/crio-1671e6012eea040f6212eb94390bbf88995fa215c4d2ae0a744aae55c3e20d4d WatchSource:0}: Error finding container 1671e6012eea040f6212eb94390bbf88995fa215c4d2ae0a744aae55c3e20d4d: Status 404 returned error can't find the container with id 1671e6012eea040f6212eb94390bbf88995fa215c4d2ae0a744aae55c3e20d4d Jul 09 14:39:06.263666 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.263607 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576"] Jul 09 14:39:06.307501 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.307477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.307592 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.307517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.307592 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.307556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2n6x\" (UniqueName: \"kubernetes.io/projected/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-kube-api-access-v2n6x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.408861 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.408783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2n6x\" (UniqueName: \"kubernetes.io/projected/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-kube-api-access-v2n6x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.408861 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.408842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.409025 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.408894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.409294 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.409271 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.409338 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.409324 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.419497 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.419473 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2n6x\" (UniqueName: \"kubernetes.io/projected/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-kube-api-access-v2n6x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.540652 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.540616 2565 generic.go:356] "Generic (PLEG): container finished" podID="a24647c2-0553-486c-a909-fd221738be1c" containerID="2b877c37a99ec59cd2455b4fce5544b8fffc378e5fea710f396fb1280abcc1b5" exitCode=0 Jul 09 14:39:06.540849 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.540665 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" event={"ID":"a24647c2-0553-486c-a909-fd221738be1c","Type":"ContainerDied","Data":"2b877c37a99ec59cd2455b4fce5544b8fffc378e5fea710f396fb1280abcc1b5"} Jul 09 14:39:06.540849 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.540739 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" event={"ID":"a24647c2-0553-486c-a909-fd221738be1c","Type":"ContainerStarted","Data":"1671e6012eea040f6212eb94390bbf88995fa215c4d2ae0a744aae55c3e20d4d"} Jul 09 14:39:06.550438 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.550415 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:06.575566 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.575544 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt"] Jul 09 14:39:06.578927 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.578910 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.594402 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.594374 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt"] Jul 09 14:39:06.681767 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.681708 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576"] Jul 09 14:39:06.683922 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:39:06.683896 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a627b5d_2f9a_47c4_923a_c704b1f8f36f.slice/crio-5ad2dc9e4631f654a600287cdb8983775742744f3bb53aa7ac1e18203ce0e4db WatchSource:0}: Error finding container 5ad2dc9e4631f654a600287cdb8983775742744f3bb53aa7ac1e18203ce0e4db: Status 404 returned error can't find the container with id 5ad2dc9e4631f654a600287cdb8983775742744f3bb53aa7ac1e18203ce0e4db Jul 09 14:39:06.711535 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.711507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gf68\" (UniqueName: \"kubernetes.io/projected/1318cb4b-5a4b-437c-8f30-7499c5cefa60-kube-api-access-7gf68\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.711637 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.711540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.711637 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.711580 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.812123 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.812097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.812411 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.812167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gf68\" (UniqueName: \"kubernetes.io/projected/1318cb4b-5a4b-437c-8f30-7499c5cefa60-kube-api-access-7gf68\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.812411 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.812192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.812493 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.812429 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.812531 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.812492 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.822117 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.822097 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gf68\" (UniqueName: \"kubernetes.io/projected/1318cb4b-5a4b-437c-8f30-7499c5cefa60-kube-api-access-7gf68\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:06.888362 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:06.888332 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:07.018372 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.018350 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt"] Jul 09 14:39:07.020100 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:39:07.020080 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1318cb4b_5a4b_437c_8f30_7499c5cefa60.slice/crio-b383a2b536f57727bb6b4a61a7be24f928727c11e776ef7b34296eef65f74f8d WatchSource:0}: Error finding container b383a2b536f57727bb6b4a61a7be24f928727c11e776ef7b34296eef65f74f8d: Status 404 returned error can't find the container with id b383a2b536f57727bb6b4a61a7be24f928727c11e776ef7b34296eef65f74f8d Jul 09 14:39:07.168962 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.168934 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64"] Jul 09 14:39:07.172098 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.172083 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.187427 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.187374 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64"] Jul 09 14:39:07.216401 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.216376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.216544 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.216428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjkr7\" (UniqueName: \"kubernetes.io/projected/9fd72a94-d904-4810-915f-da57848abcbc-kube-api-access-gjkr7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.216544 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.216458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.317040 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.317009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjkr7\" (UniqueName: \"kubernetes.io/projected/9fd72a94-d904-4810-915f-da57848abcbc-kube-api-access-gjkr7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.317040 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.317047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.317278 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.317106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.317475 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.317447 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.317525 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.317479 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.327888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.327858 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjkr7\" (UniqueName: \"kubernetes.io/projected/9fd72a94-d904-4810-915f-da57848abcbc-kube-api-access-gjkr7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.493419 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.493343 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:07.549626 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.549539 2565 generic.go:356] "Generic (PLEG): container finished" podID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerID="16f2dc1be818da88ef11c82e58d5166353706411d14d836df2735d9c9b1887e9" exitCode=0 Jul 09 14:39:07.549626 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.549599 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" event={"ID":"1318cb4b-5a4b-437c-8f30-7499c5cefa60","Type":"ContainerDied","Data":"16f2dc1be818da88ef11c82e58d5166353706411d14d836df2735d9c9b1887e9"} Jul 09 14:39:07.549866 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.549662 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" event={"ID":"1318cb4b-5a4b-437c-8f30-7499c5cefa60","Type":"ContainerStarted","Data":"b383a2b536f57727bb6b4a61a7be24f928727c11e776ef7b34296eef65f74f8d"} Jul 09 14:39:07.552171 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.552151 2565 generic.go:356] "Generic (PLEG): container finished" podID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerID="ed9d9b6ced036d2adfc9feb5ecd604b575da4d1db30eb6d4357668e17d9d393c" exitCode=0 Jul 09 14:39:07.552422 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.552403 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" event={"ID":"7a627b5d-2f9a-47c4-923a-c704b1f8f36f","Type":"ContainerDied","Data":"ed9d9b6ced036d2adfc9feb5ecd604b575da4d1db30eb6d4357668e17d9d393c"} Jul 09 14:39:07.552479 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.552469 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" event={"ID":"7a627b5d-2f9a-47c4-923a-c704b1f8f36f","Type":"ContainerStarted","Data":"5ad2dc9e4631f654a600287cdb8983775742744f3bb53aa7ac1e18203ce0e4db"} Jul 09 14:39:07.636420 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:07.636396 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64"] Jul 09 14:39:07.638536 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:39:07.638511 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd72a94_d904_4810_915f_da57848abcbc.slice/crio-5f5e37befc84b70753a4dec9d832eaef1a5bbc075c1c82a2627d39cfda86c468 WatchSource:0}: Error finding container 5f5e37befc84b70753a4dec9d832eaef1a5bbc075c1c82a2627d39cfda86c468: Status 404 returned error can't find the container with id 5f5e37befc84b70753a4dec9d832eaef1a5bbc075c1c82a2627d39cfda86c468 Jul 09 14:39:08.558351 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:08.558320 2565 generic.go:356] "Generic (PLEG): container finished" podID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerID="24d36bf1b31e6ddbf89e02b8885b50af9439f675d803da5a85d62411e3f8494d" exitCode=0 Jul 09 14:39:08.558649 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:08.558395 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" event={"ID":"1318cb4b-5a4b-437c-8f30-7499c5cefa60","Type":"ContainerDied","Data":"24d36bf1b31e6ddbf89e02b8885b50af9439f675d803da5a85d62411e3f8494d"} Jul 09 14:39:08.559975 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:08.559950 2565 generic.go:356] "Generic (PLEG): container finished" podID="9fd72a94-d904-4810-915f-da57848abcbc" containerID="edf7827a9356d59d11402714bf4dcb6634aa7af1120216ef5061e037f421e472" exitCode=0 Jul 09 14:39:08.560074 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:08.560008 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" event={"ID":"9fd72a94-d904-4810-915f-da57848abcbc","Type":"ContainerDied","Data":"edf7827a9356d59d11402714bf4dcb6634aa7af1120216ef5061e037f421e472"} Jul 09 14:39:08.560074 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:08.560046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" event={"ID":"9fd72a94-d904-4810-915f-da57848abcbc","Type":"ContainerStarted","Data":"5f5e37befc84b70753a4dec9d832eaef1a5bbc075c1c82a2627d39cfda86c468"} Jul 09 14:39:09.570221 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:09.570195 2565 generic.go:356] "Generic (PLEG): container finished" podID="a24647c2-0553-486c-a909-fd221738be1c" containerID="6793297cf6f7bab791ea87a9bfca2d212bd64e9e3b9aea1ae4e92d32df49b04a" exitCode=0 Jul 09 14:39:09.570561 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:09.570274 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" event={"ID":"a24647c2-0553-486c-a909-fd221738be1c","Type":"ContainerDied","Data":"6793297cf6f7bab791ea87a9bfca2d212bd64e9e3b9aea1ae4e92d32df49b04a"} Jul 09 14:39:09.572691 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:09.572655 2565 generic.go:356] "Generic (PLEG): container finished" podID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerID="84b6472fd5171ed59b6403fd3f6179ecd1fe4a0f3616b8948cec5b49f28a9a0f" exitCode=0 Jul 09 14:39:09.572778 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:09.572722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" event={"ID":"1318cb4b-5a4b-437c-8f30-7499c5cefa60","Type":"ContainerDied","Data":"84b6472fd5171ed59b6403fd3f6179ecd1fe4a0f3616b8948cec5b49f28a9a0f"} Jul 09 14:39:09.574470 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:09.574451 2565 generic.go:356] "Generic (PLEG): container finished" podID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerID="b151874cedfdb373655db91744bf4b12f574231a96336f76780ee4a3e7e92b85" exitCode=0 Jul 09 14:39:09.574567 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:09.574486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" event={"ID":"7a627b5d-2f9a-47c4-923a-c704b1f8f36f","Type":"ContainerDied","Data":"b151874cedfdb373655db91744bf4b12f574231a96336f76780ee4a3e7e92b85"} Jul 09 14:39:10.581265 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.581227 2565 generic.go:356] "Generic (PLEG): container finished" podID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerID="6a8c2d122562330816aa79e18aae16f8ae46e301f2739e45d94a218472c1b187" exitCode=0 Jul 09 14:39:10.581692 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.581314 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" event={"ID":"7a627b5d-2f9a-47c4-923a-c704b1f8f36f","Type":"ContainerDied","Data":"6a8c2d122562330816aa79e18aae16f8ae46e301f2739e45d94a218472c1b187"} Jul 09 14:39:10.583272 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.583244 2565 generic.go:356] "Generic (PLEG): container finished" podID="a24647c2-0553-486c-a909-fd221738be1c" containerID="953c6e5366acd4c347d20640d86ca8a8ff427b2d4994c17ea38d476c1d6fe9e8" exitCode=0 Jul 09 14:39:10.583391 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.583319 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" event={"ID":"a24647c2-0553-486c-a909-fd221738be1c","Type":"ContainerDied","Data":"953c6e5366acd4c347d20640d86ca8a8ff427b2d4994c17ea38d476c1d6fe9e8"} Jul 09 14:39:10.584872 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.584852 2565 generic.go:356] "Generic (PLEG): container finished" podID="9fd72a94-d904-4810-915f-da57848abcbc" containerID="2a448908229d04341b110e860c89130772d7d7c85e8e4e932469bca9ea3148a3" exitCode=0 Jul 09 14:39:10.584972 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.584931 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" event={"ID":"9fd72a94-d904-4810-915f-da57848abcbc","Type":"ContainerDied","Data":"2a448908229d04341b110e860c89130772d7d7c85e8e4e932469bca9ea3148a3"} Jul 09 14:39:10.714016 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.713994 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:10.845721 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.845633 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gf68\" (UniqueName: \"kubernetes.io/projected/1318cb4b-5a4b-437c-8f30-7499c5cefa60-kube-api-access-7gf68\") pod \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " Jul 09 14:39:10.845721 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.845671 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-util\") pod \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " Jul 09 14:39:10.845942 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.845740 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-bundle\") pod \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\" (UID: \"1318cb4b-5a4b-437c-8f30-7499c5cefa60\") " Jul 09 14:39:10.846172 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.846138 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-bundle" (OuterVolumeSpecName: "bundle") pod "1318cb4b-5a4b-437c-8f30-7499c5cefa60" (UID: "1318cb4b-5a4b-437c-8f30-7499c5cefa60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:39:10.847883 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.847860 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1318cb4b-5a4b-437c-8f30-7499c5cefa60-kube-api-access-7gf68" (OuterVolumeSpecName: "kube-api-access-7gf68") pod "1318cb4b-5a4b-437c-8f30-7499c5cefa60" (UID: "1318cb4b-5a4b-437c-8f30-7499c5cefa60"). InnerVolumeSpecName "kube-api-access-7gf68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:39:10.851199 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.851160 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-util" (OuterVolumeSpecName: "util") pod "1318cb4b-5a4b-437c-8f30-7499c5cefa60" (UID: "1318cb4b-5a4b-437c-8f30-7499c5cefa60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:39:10.946330 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.946299 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gf68\" (UniqueName: \"kubernetes.io/projected/1318cb4b-5a4b-437c-8f30-7499c5cefa60-kube-api-access-7gf68\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:10.946330 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.946325 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-util\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:10.946330 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:10.946334 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1318cb4b-5a4b-437c-8f30-7499c5cefa60-bundle\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:11.592010 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.591970 2565 generic.go:356] "Generic (PLEG): container finished" podID="9fd72a94-d904-4810-915f-da57848abcbc" containerID="a9c5267c0655f2c00497b6f1a5d2d4f3f0da542ca2cff23a05d81cbd07af5a8d" exitCode=0 Jul 09 14:39:11.592405 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.592059 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" event={"ID":"9fd72a94-d904-4810-915f-da57848abcbc","Type":"ContainerDied","Data":"a9c5267c0655f2c00497b6f1a5d2d4f3f0da542ca2cff23a05d81cbd07af5a8d"} Jul 09 14:39:11.593802 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.593781 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" Jul 09 14:39:11.593888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.593812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt" event={"ID":"1318cb4b-5a4b-437c-8f30-7499c5cefa60","Type":"ContainerDied","Data":"b383a2b536f57727bb6b4a61a7be24f928727c11e776ef7b34296eef65f74f8d"} Jul 09 14:39:11.593888 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.593847 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b383a2b536f57727bb6b4a61a7be24f928727c11e776ef7b34296eef65f74f8d" Jul 09 14:39:11.722435 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.722407 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:11.754723 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.754702 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:11.854074 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.853981 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-bundle\") pod \"a24647c2-0553-486c-a909-fd221738be1c\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " Jul 09 14:39:11.854074 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.854027 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdcjc\" (UniqueName: \"kubernetes.io/projected/a24647c2-0553-486c-a909-fd221738be1c-kube-api-access-pdcjc\") pod \"a24647c2-0553-486c-a909-fd221738be1c\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " Jul 09 14:39:11.854074 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.854052 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-util\") pod \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " Jul 09 14:39:11.854320 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.854104 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-bundle\") pod \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " Jul 09 14:39:11.854320 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.854152 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-util\") pod \"a24647c2-0553-486c-a909-fd221738be1c\" (UID: \"a24647c2-0553-486c-a909-fd221738be1c\") " Jul 09 14:39:11.854320 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.854185 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2n6x\" (UniqueName: \"kubernetes.io/projected/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-kube-api-access-v2n6x\") pod \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\" (UID: \"7a627b5d-2f9a-47c4-923a-c704b1f8f36f\") " Jul 09 14:39:11.854761 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.854727 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-bundle" (OuterVolumeSpecName: "bundle") pod "7a627b5d-2f9a-47c4-923a-c704b1f8f36f" (UID: "7a627b5d-2f9a-47c4-923a-c704b1f8f36f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:39:11.854869 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.854788 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-bundle" (OuterVolumeSpecName: "bundle") pod "a24647c2-0553-486c-a909-fd221738be1c" (UID: "a24647c2-0553-486c-a909-fd221738be1c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:39:11.856266 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.856241 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24647c2-0553-486c-a909-fd221738be1c-kube-api-access-pdcjc" (OuterVolumeSpecName: "kube-api-access-pdcjc") pod "a24647c2-0553-486c-a909-fd221738be1c" (UID: "a24647c2-0553-486c-a909-fd221738be1c"). InnerVolumeSpecName "kube-api-access-pdcjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:39:11.856351 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.856322 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-kube-api-access-v2n6x" (OuterVolumeSpecName: "kube-api-access-v2n6x") pod "7a627b5d-2f9a-47c4-923a-c704b1f8f36f" (UID: "7a627b5d-2f9a-47c4-923a-c704b1f8f36f"). InnerVolumeSpecName "kube-api-access-v2n6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:39:11.859262 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.859228 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-util" (OuterVolumeSpecName: "util") pod "a24647c2-0553-486c-a909-fd221738be1c" (UID: "a24647c2-0553-486c-a909-fd221738be1c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:39:11.860012 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.859994 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-util" (OuterVolumeSpecName: "util") pod "7a627b5d-2f9a-47c4-923a-c704b1f8f36f" (UID: "7a627b5d-2f9a-47c4-923a-c704b1f8f36f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:39:11.955703 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.955650 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-util\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:11.955832 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.955780 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2n6x\" (UniqueName: \"kubernetes.io/projected/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-kube-api-access-v2n6x\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:11.955832 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.955792 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a24647c2-0553-486c-a909-fd221738be1c-bundle\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:11.955832 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.955802 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdcjc\" (UniqueName: \"kubernetes.io/projected/a24647c2-0553-486c-a909-fd221738be1c-kube-api-access-pdcjc\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:11.955832 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.955810 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-util\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:11.955832 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:11.955818 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a627b5d-2f9a-47c4-923a-c704b1f8f36f-bundle\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:12.600048 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.600015 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" Jul 09 14:39:12.600048 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.600036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576" event={"ID":"7a627b5d-2f9a-47c4-923a-c704b1f8f36f","Type":"ContainerDied","Data":"5ad2dc9e4631f654a600287cdb8983775742744f3bb53aa7ac1e18203ce0e4db"} Jul 09 14:39:12.600506 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.600086 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ad2dc9e4631f654a600287cdb8983775742744f3bb53aa7ac1e18203ce0e4db" Jul 09 14:39:12.601808 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.601790 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" Jul 09 14:39:12.601946 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.601827 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5" event={"ID":"a24647c2-0553-486c-a909-fd221738be1c","Type":"ContainerDied","Data":"1671e6012eea040f6212eb94390bbf88995fa215c4d2ae0a744aae55c3e20d4d"} Jul 09 14:39:12.601946 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.601866 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1671e6012eea040f6212eb94390bbf88995fa215c4d2ae0a744aae55c3e20d4d" Jul 09 14:39:12.731649 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.731627 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:12.864256 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.864177 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjkr7\" (UniqueName: \"kubernetes.io/projected/9fd72a94-d904-4810-915f-da57848abcbc-kube-api-access-gjkr7\") pod \"9fd72a94-d904-4810-915f-da57848abcbc\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " Jul 09 14:39:12.864256 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.864237 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-bundle\") pod \"9fd72a94-d904-4810-915f-da57848abcbc\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " Jul 09 14:39:12.864467 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.864289 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-util\") pod \"9fd72a94-d904-4810-915f-da57848abcbc\" (UID: \"9fd72a94-d904-4810-915f-da57848abcbc\") " Jul 09 14:39:12.864812 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.864786 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-bundle" (OuterVolumeSpecName: "bundle") pod "9fd72a94-d904-4810-915f-da57848abcbc" (UID: "9fd72a94-d904-4810-915f-da57848abcbc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:39:12.866338 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.866309 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fd72a94-d904-4810-915f-da57848abcbc-kube-api-access-gjkr7" (OuterVolumeSpecName: "kube-api-access-gjkr7") pod "9fd72a94-d904-4810-915f-da57848abcbc" (UID: "9fd72a94-d904-4810-915f-da57848abcbc"). InnerVolumeSpecName "kube-api-access-gjkr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:39:12.869796 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.869776 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-util" (OuterVolumeSpecName: "util") pod "9fd72a94-d904-4810-915f-da57848abcbc" (UID: "9fd72a94-d904-4810-915f-da57848abcbc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:39:12.965077 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.965044 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjkr7\" (UniqueName: \"kubernetes.io/projected/9fd72a94-d904-4810-915f-da57848abcbc-kube-api-access-gjkr7\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:12.965077 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.965074 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-bundle\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:12.965077 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:12.965085 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fd72a94-d904-4810-915f-da57848abcbc-util\") on node \"ip-10-0-132-123.ec2.internal\" DevicePath \"\"" Jul 09 14:39:13.607987 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:13.607958 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" Jul 09 14:39:13.608358 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:13.607961 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64" event={"ID":"9fd72a94-d904-4810-915f-da57848abcbc","Type":"ContainerDied","Data":"5f5e37befc84b70753a4dec9d832eaef1a5bbc075c1c82a2627d39cfda86c468"} Jul 09 14:39:13.608358 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:39:13.608072 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f5e37befc84b70753a4dec9d832eaef1a5bbc075c1c82a2627d39cfda86c468" Jul 09 14:41:15.221125 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:15.221053 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdc9c95cd-db8vf_0744062a-c3cc-493e-bcf6-f188b1378a07/copy-manifests/0.log" Jul 09 14:41:15.228257 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:15.228222 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdc9c95cd-db8vf_0744062a-c3cc-493e-bcf6-f188b1378a07/manager/0.log" Jul 09 14:41:16.506288 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.506253 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt_1318cb4b-5a4b-437c-8f30-7499c5cefa60/util/0.log" Jul 09 14:41:16.515380 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.515352 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt_1318cb4b-5a4b-437c-8f30-7499c5cefa60/pull/0.log" Jul 09 14:41:16.521877 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.521856 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt_1318cb4b-5a4b-437c-8f30-7499c5cefa60/extract/0.log" Jul 09 14:41:16.640328 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.640304 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576_7a627b5d-2f9a-47c4-923a-c704b1f8f36f/pull/0.log" Jul 09 14:41:16.647019 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.646991 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576_7a627b5d-2f9a-47c4-923a-c704b1f8f36f/extract/0.log" Jul 09 14:41:16.653123 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.653106 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576_7a627b5d-2f9a-47c4-923a-c704b1f8f36f/util/0.log" Jul 09 14:41:16.774668 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.774597 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5_a24647c2-0553-486c-a909-fd221738be1c/extract/0.log" Jul 09 14:41:16.781626 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.781604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5_a24647c2-0553-486c-a909-fd221738be1c/util/0.log" Jul 09 14:41:16.788409 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.788381 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5_a24647c2-0553-486c-a909-fd221738be1c/pull/0.log" Jul 09 14:41:16.925489 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.925463 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64_9fd72a94-d904-4810-915f-da57848abcbc/util/0.log" Jul 09 14:41:16.931770 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.931744 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64_9fd72a94-d904-4810-915f-da57848abcbc/pull/0.log" Jul 09 14:41:16.937953 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:16.937928 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64_9fd72a94-d904-4810-915f-da57848abcbc/extract/0.log" Jul 09 14:41:18.240802 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:18.240774 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vt6lq_64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f/istio-proxy/0.log" Jul 09 14:41:18.382901 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:18.382869 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5nwjr_078ca648-67b7-4edf-aa30-89070efb537a/discovery/0.log" Jul 09 14:41:18.853013 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:18.852983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-976764b8d-88jrj_d9f81b25-bc4a-4510-b7a3-dda245a8180d/router/0.log" Jul 09 14:41:25.723762 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:25.723732 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pc8dz_a84b571e-13fd-4648-b24c-8e23722e4f7a/global-pull-secret-syncer/0.log" Jul 09 14:41:25.825310 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:25.825277 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zdbtf_927ddcb4-5717-487e-a54a-9ebd9e52ab87/konnectivity-agent/0.log" Jul 09 14:41:25.846156 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:25.846132 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-123.ec2.internal_ad3d36c070043dd6db6d4a5194d07329/haproxy/0.log" Jul 09 14:41:30.592766 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.592730 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt_1318cb4b-5a4b-437c-8f30-7499c5cefa60/extract/0.log" Jul 09 14:41:30.613620 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.613593 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt_1318cb4b-5a4b-437c-8f30-7499c5cefa60/util/0.log" Jul 09 14:41:30.634427 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.634401 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592x7jt_1318cb4b-5a4b-437c-8f30-7499c5cefa60/pull/0.log" Jul 09 14:41:30.663538 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.663503 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576_7a627b5d-2f9a-47c4-923a-c704b1f8f36f/extract/0.log" Jul 09 14:41:30.687135 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.687111 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576_7a627b5d-2f9a-47c4-923a-c704b1f8f36f/util/0.log" Jul 09 14:41:30.711850 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.711824 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4576_7a627b5d-2f9a-47c4-923a-c704b1f8f36f/pull/0.log" Jul 09 14:41:30.736495 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.736471 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5_a24647c2-0553-486c-a909-fd221738be1c/extract/0.log" Jul 09 14:41:30.766728 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.766702 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5_a24647c2-0553-486c-a909-fd221738be1c/util/0.log" Jul 09 14:41:30.787777 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.787748 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ft9w5_a24647c2-0553-486c-a909-fd221738be1c/pull/0.log" Jul 09 14:41:30.812946 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.812921 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64_9fd72a94-d904-4810-915f-da57848abcbc/extract/0.log" Jul 09 14:41:30.832552 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.832526 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64_9fd72a94-d904-4810-915f-da57848abcbc/util/0.log" Jul 09 14:41:30.853766 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:30.853702 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwz64_9fd72a94-d904-4810-915f-da57848abcbc/pull/0.log" Jul 09 14:41:33.343835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:33.343805 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h87pt_1686660c-742d-473b-afe3-4c37d902464e/node-exporter/0.log" Jul 09 14:41:33.366172 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:33.366127 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h87pt_1686660c-742d-473b-afe3-4c37d902464e/kube-rbac-proxy/0.log" Jul 09 14:41:33.384671 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:33.384648 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h87pt_1686660c-742d-473b-afe3-4c37d902464e/init-textfile/0.log" Jul 09 14:41:35.949054 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949022 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9"] Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949270 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerName="extract" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949281 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerName="extract" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949291 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerName="util" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949297 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerName="util" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949304 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24647c2-0553-486c-a909-fd221738be1c" containerName="extract" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949309 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24647c2-0553-486c-a909-fd221738be1c" containerName="extract" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949318 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerName="pull" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949323 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerName="pull" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949331 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24647c2-0553-486c-a909-fd221738be1c" containerName="pull" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949336 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24647c2-0553-486c-a909-fd221738be1c" containerName="pull" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949341 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24647c2-0553-486c-a909-fd221738be1c" containerName="util" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949346 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24647c2-0553-486c-a909-fd221738be1c" containerName="util" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949352 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerName="extract" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949357 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerName="extract" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949364 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fd72a94-d904-4810-915f-da57848abcbc" containerName="util" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949370 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fd72a94-d904-4810-915f-da57848abcbc" containerName="util" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949375 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fd72a94-d904-4810-915f-da57848abcbc" containerName="extract" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949380 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fd72a94-d904-4810-915f-da57848abcbc" containerName="extract" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949386 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerName="util" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949391 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerName="util" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949400 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fd72a94-d904-4810-915f-da57848abcbc" containerName="pull" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949405 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fd72a94-d904-4810-915f-da57848abcbc" containerName="pull" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949411 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerName="pull" Jul 09 14:41:35.949410 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949415 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerName="pull" Jul 09 14:41:35.950525 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949469 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1318cb4b-5a4b-437c-8f30-7499c5cefa60" containerName="extract" Jul 09 14:41:35.950525 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949476 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24647c2-0553-486c-a909-fd221738be1c" containerName="extract" Jul 09 14:41:35.950525 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949481 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fd72a94-d904-4810-915f-da57848abcbc" containerName="extract" Jul 09 14:41:35.950525 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.949489 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a627b5d-2f9a-47c4-923a-c704b1f8f36f" containerName="extract" Jul 09 14:41:35.952330 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.952310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:35.955279 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.955242 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47plb\"/\"kube-root-ca.crt\"" Jul 09 14:41:35.955412 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.955276 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47plb\"/\"openshift-service-ca.crt\"" Jul 09 14:41:35.956738 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.956722 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-47plb\"/\"default-dockercfg-5zln7\"" Jul 09 14:41:35.962810 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:35.962789 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9"] Jul 09 14:41:36.070965 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.070929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-lib-modules\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.071131 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.070974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-sys\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.071131 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.070998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-podres\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.071131 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.071062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnnst\" (UniqueName: \"kubernetes.io/projected/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-kube-api-access-pnnst\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.071131 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.071117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-proc\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.172313 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.172282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnnst\" (UniqueName: \"kubernetes.io/projected/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-kube-api-access-pnnst\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.172460 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.172330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-proc\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.172460 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.172362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-lib-modules\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.172460 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.172395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-sys\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.172460 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.172419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-podres\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.172638 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.172480 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-proc\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.172638 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.172485 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-sys\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.172638 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.172533 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-lib-modules\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.172638 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.172553 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-podres\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.181801 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.181773 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnnst\" (UniqueName: \"kubernetes.io/projected/743c3e70-6e72-4b3c-beec-32f8c0e4dc92-kube-api-access-pnnst\") pod \"perf-node-gather-daemonset-6zpl9\" (UID: \"743c3e70-6e72-4b3c-beec-32f8c0e4dc92\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.262242 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.262158 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:36.387710 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:36.387672 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9"] Jul 09 14:41:36.392167 ip-10-0-132-123 kubenswrapper[2565]: W0709 14:41:36.389991 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod743c3e70_6e72_4b3c_beec_32f8c0e4dc92.slice/crio-97e40f5971f35f4a4ed9a084307dd6ca28c306fbe5dd6f2adb97079903e1c6e5 WatchSource:0}: Error finding container 97e40f5971f35f4a4ed9a084307dd6ca28c306fbe5dd6f2adb97079903e1c6e5: Status 404 returned error can't find the container with id 97e40f5971f35f4a4ed9a084307dd6ca28c306fbe5dd6f2adb97079903e1c6e5 Jul 09 14:41:37.238958 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:37.238919 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" event={"ID":"743c3e70-6e72-4b3c-beec-32f8c0e4dc92","Type":"ContainerStarted","Data":"2df40510cd369f14a564058959c9eeec03a51743ca80888606abc596a97ab985"} Jul 09 14:41:37.239398 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:37.238976 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" event={"ID":"743c3e70-6e72-4b3c-beec-32f8c0e4dc92","Type":"ContainerStarted","Data":"97e40f5971f35f4a4ed9a084307dd6ca28c306fbe5dd6f2adb97079903e1c6e5"} Jul 09 14:41:37.239398 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:37.239005 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:37.258090 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:37.258043 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" podStartSLOduration=2.258027507 podStartE2EDuration="2.258027507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:41:37.256903636 +0000 UTC m=+597.041747684" watchObservedRunningTime="2026-07-09 14:41:37.258027507 +0000 UTC m=+597.042871553" Jul 09 14:41:38.148732 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:38.148706 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mhlm6_aab174e9-6ddb-47cf-9352-c06fa436fa05/dns/0.log" Jul 09 14:41:38.170157 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:38.170134 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mhlm6_aab174e9-6ddb-47cf-9352-c06fa436fa05/kube-rbac-proxy/0.log" Jul 09 14:41:38.297566 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:38.297537 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znhx8_dd56578a-50aa-4c05-98eb-f918768d2392/dns-node-resolver/0.log" Jul 09 14:41:38.838725 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:38.838697 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dmlkq_890717d4-da1d-4362-a06d-ee3c6bf0197d/node-ca/0.log" Jul 09 14:41:39.851463 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:39.851423 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vt6lq_64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f/istio-proxy/0.log" Jul 09 14:41:39.901568 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:39.901526 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5nwjr_078ca648-67b7-4edf-aa30-89070efb537a/discovery/0.log" Jul 09 14:41:40.003560 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:40.003536 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-976764b8d-88jrj_d9f81b25-bc4a-4510-b7a3-dda245a8180d/router/0.log" Jul 09 14:41:40.613836 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:40.613805 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-krz99_0eb4db29-d9e0-4969-ad60-40ace741704a/serve-healthcheck-canary/0.log" Jul 09 14:41:40.675721 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:40.675696 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt4vr_4bfdb2d6-4c5e-476a-8d63-43b25e66940a/ovn-acl-logging/0.log" Jul 09 14:41:40.677115 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:40.677096 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zt4vr_4bfdb2d6-4c5e-476a-8d63-43b25e66940a/ovn-acl-logging/0.log" Jul 09 14:41:41.140907 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:41.140799 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qdf8n_e9a24882-b0bb-46de-93c9-e2b9caa49bd6/kube-rbac-proxy/0.log" Jul 09 14:41:41.161870 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:41.161844 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qdf8n_e9a24882-b0bb-46de-93c9-e2b9caa49bd6/exporter/0.log" Jul 09 14:41:41.182835 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:41.182809 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qdf8n_e9a24882-b0bb-46de-93c9-e2b9caa49bd6/extractor/0.log" Jul 09 14:41:43.258047 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:43.258023 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-6zpl9" Jul 09 14:41:43.692435 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:43.692388 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdc9c95cd-db8vf_0744062a-c3cc-493e-bcf6-f188b1378a07/manager/0.log" Jul 09 14:41:43.713371 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:43.713349 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdc9c95cd-db8vf_0744062a-c3cc-493e-bcf6-f188b1378a07/copy-manifests/0.log" Jul 09 14:41:45.044910 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:45.044870 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-746b95fc8f-wfz55_fc6177c0-b7ab-4d97-a5a6-0bddb63f4827/manager/0.log" Jul 09 14:41:46.381004 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:46.380883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vt6lq_64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f/istio-proxy/0.log" Jul 09 14:41:46.421507 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:46.421475 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5nwjr_078ca648-67b7-4edf-aa30-89070efb537a/discovery/0.log" Jul 09 14:41:46.483411 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:46.483377 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-976764b8d-88jrj_d9f81b25-bc4a-4510-b7a3-dda245a8180d/router/0.log" Jul 09 14:41:47.576733 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:47.576620 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vt6lq_64e6fbb2-f0b0-46f6-8bbc-ab6b91f3d45f/istio-proxy/0.log" Jul 09 14:41:47.619917 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:47.619889 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5nwjr_078ca648-67b7-4edf-aa30-89070efb537a/discovery/0.log" Jul 09 14:41:47.690773 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:47.690745 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-976764b8d-88jrj_d9f81b25-bc4a-4510-b7a3-dda245a8180d/router/0.log" Jul 09 14:41:52.068635 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.068559 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x6727_12055efe-4e0c-4d22-9dfb-4bea12beaa7c/kube-multus-additional-cni-plugins/0.log" Jul 09 14:41:52.089826 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.089805 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x6727_12055efe-4e0c-4d22-9dfb-4bea12beaa7c/egress-router-binary-copy/0.log" Jul 09 14:41:52.110974 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.110948 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x6727_12055efe-4e0c-4d22-9dfb-4bea12beaa7c/cni-plugins/0.log" Jul 09 14:41:52.131857 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.131827 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x6727_12055efe-4e0c-4d22-9dfb-4bea12beaa7c/bond-cni-plugin/0.log" Jul 09 14:41:52.152569 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.152545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x6727_12055efe-4e0c-4d22-9dfb-4bea12beaa7c/routeoverride-cni/0.log" Jul 09 14:41:52.173576 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.173547 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x6727_12055efe-4e0c-4d22-9dfb-4bea12beaa7c/whereabouts-cni-bincopy/0.log" Jul 09 14:41:52.193274 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.193245 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x6727_12055efe-4e0c-4d22-9dfb-4bea12beaa7c/whereabouts-cni/0.log" Jul 09 14:41:52.225604 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.225560 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nkqcz_380db035-1473-4b1b-b5c6-0b36dd2145e4/kube-multus/0.log" Jul 09 14:41:52.270619 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.270581 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5979f_b7e3791a-647d-4eba-a8e7-820a07879e4e/network-metrics-daemon/0.log" Jul 09 14:41:52.290445 ip-10-0-132-123 kubenswrapper[2565]: I0709 14:41:52.290421 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5979f_b7e3791a-647d-4eba-a8e7-820a07879e4e/kube-rbac-proxy/0.log"